Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “behavior modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

How AI Predicts the Untrained and Unseen

Focus Area: Model predictability improvements (Primary); Data optimization (secondary); Data complexity insights (secondary). The Scientific Challenge: If we believe that a future under extreme conditions will look very differently from today, we can likely agree that ML/AI models trained on past and present datasets will not be adequate to make reliable predictions into the future. This is true for water cycling, as well as biogeochemistry and other Earth system components and behaviors. Additionally, ML/AI models are inherently non-physical. Despite the flourishing success of ML/AI in many applications, such as computer vision, natural language process, and gaming, even the most sophisticated AI models don’t understand the very basic physical laws. Therefore, a natural question is: Can we trust ML/AI based predictions of Earth system behaviors that are fundamentally driven by physical laws? So, are physics models with meticulous process representation a better choice? Not exactly. Physical models, when firmly rooted in first principles, work great at predicting behaviors of systems with a well-defined set of boundary conditions and variables. However, as a complex system, the number of parameters and the degree of complexity and dynamics in processes, coupling, and scale dependent emergent behaviors make the Earth system behaviors very challenging to predict with physical models composed of deterministic laws. In addition, due to the lack of fundamental understandings, physical models often implement empirical correlations derived from observations with biases from locality of data generation. Because correlation is not necessarily causation or comply with first principles, scaling of model predictions beyond locality is often invalid. Beyond the limitation of models, physics or AI, our knowledge of the Earth system is limited by the lack of observational technologies and resources. Insufficient data density, dimensionality and diversity only offer a sliced (or projected) view of the Earth system, e.g. Plato’s Cave analogy, limiting our capability to better understand and represent fundamental processes in models.

54 ENVIRONMENTAL SCIENCES↗

Modeling the Impacts of Material Properties on Oscillatory Neuron Behavior

In this study, neuromorphic computing, which mimics the functions of biological brains, offers improvements in both latency and energy efficiency over typical von Neumann computing architectures. Spiking neural networks can be especially power-efficient because they encode information temporally and can use more sparse electrical inputs. Here, we study the design of volatile memristors (variable resistors with memory) for neuronal devices, with particular consideration toward the feasibility of all-on-chip oscillation using built-in capacitance. We use circuit simulations to model the behavior of oscillator neurons with a range of realistic material properties. We find that energy inputs increase with insulating-phase resistivity, thermal conductivity, and device aspect ratio. However, we also find that the minimum capacitance needed for oscillation decreases with increasing insulating-phase resistivity, which opposes the constraints for power efficiency. Based on published data on NbO 2 , VO 2 , and EuNiO 3 , we find that existing materials can be engineered for all-on-chip spiking using their parasitic capacitance.

36 MATERIALS SCIENCE↗

Neural Scaling Laws for Jet Generation

Recently observed empirical scaling laws describe the performance of foundation-type models as three independent key quantities -- dataset size, compute, and model parameters -- are modified. Extracting these scaling laws informs the training of large complex models for which the tuning of hyperparameters in traditional ways is not feasible. This work for the first time explores if scaling laws can also be observed for the task of particle jet generation -- both relevant as a pre-training objective for foundation models and as in-situ simulation by itself. We indeed replicate the key logarithmic scaling law behavior for model-size scaling. Beyond studying the next token prediction validation loss of the generative model, we also study the sliced Wasserstein distance of five physical quantities that are not immediately available to the model during training. Our study shows that this quantity is monotonically related to the next token prediction validation loss, meaning that this loss is indeed a good proxy for the physics performance. For the scaling with dataset size and compute, we observe substantially weaker scaling behavior of both the loss and the sliced Wasserstein distance. We analyze this behavior by introducing the concept of a learnable window, and argue that autoregressive next token prediction on jet constituents exhibits comparatively rapid saturation relative to language-model studies. We discuss possible origins of this behavior, including the stochastic nature of QCD radiation and differences between generative and supervised learning tasks in collider physics.

Amram, Oz [Fermilab]↗

Symbolic LTL Compilation for Model Checking: Extended Abstract

In Linear Temporal Logic (LTL) model checking, we check LTL formulas representing desired behaviors against a formal model of the system designed to exhibit these behaviors. To accomplish this task, the LTL formulas must be translated into automata [21]. We focus on LTL compilation by investigating LTL satisfiability checking via a reduction to model checking. Having shown that symbolic LTL compilation algorithms are superior to explicit automata construction algorithms for this task [16], we concentrate here on seeking a better symbolic algorithm.We present experimental data comparing algorithmic variations such as normal forms, encoding methods, and variable ordering and examine their effects on performance metrics including processing time and scalability. Safety critical systems, such as air traffic control, life support systems, hazardous environment controls, and automotive control systems, pervade our daily lives, yet testing and simulation alone cannot adequately verify their reliability [3]. Model checking is a promising approach to formal verification for safety critical systems which involves creating a formal mathematical model of the system and translating desired safety properties into a formal specification for this model. The complement of the specification is then checked against the system model. When the model does not satisfy the specification, model-checking tools accompany this negative answer with a counterexample, which points to an inconsistency between the system and the desired behaviors and aids debugging efforts.

Rozier, Kristin Y.↗

Automating CPM-GOMS

CPM-GOMS is a modeling method that combines the task decomposition of a GOMS analysis with a model of human resource usage at the level of cognitive, perceptual, and motor operations. CPM-GOMS models have made accurate predictions about skilled user behavior in routine tasks, but developing such models is tedious and error-prone. We describe a process for automatically generating CPM-GOMS models from a hierarchical task decomposition expressed in a cognitive modeling tool called Apex. Resource scheduling in Apex automates the difficult task of interleaving the cognitive, perceptual, and motor resources underlying common task operators (e.g. mouse move-and-click). Apex's UI automatically generates PERT charts, which allow modelers to visualize a model's complex parallel behavior. Because interleaving and visualization is now automated, it is feasible to construct arbitrarily long sequences of behavior. To demonstrate the process, we present a model of automated teller interactions in Apex and discuss implications for user modeling. available to model human users, the Goals, Operators, Methods, and Selection (GOMS) method [6, 21] has been the most widely used, providing accurate, often zero-parameter, predictions of the routine performance of skilled users in a wide range of procedural tasks [6, 13, 15, 27, 28]. GOMS is meant to model routine behavior. The user is assumed to have methods that apply sequences of operators and to achieve a goal. Selection rules are applied when there is more than one method to achieve a goal. Many routine tasks lend themselves well to such decomposition. Decomposition produces a representation of the task as a set of nested goal states that include an initial state and a final state. The iterative decomposition into goals and nested subgoals can terminate in primitives of any desired granularity, the choice of level of detail dependent on the predictions required. Although GOMS has proven useful in HCI, tools to support the construction of GOMS models have not yet come into general use.

GOMS↗

A two-phase substrate model for enzymatic hydrolysis of lignocellulose: application to batch and continuous reactors

Abstract Background Enzymatic hydrolysis continues to have a significant projected production cost for the biological conversion of biomass to fuels and chemicals, motivating research into improved enzyme and reactor technologies in order to reduce enzyme usage and equipment costs. However, technology development is stymied by a lack of accurate and computationally accessible enzymatic-hydrolysis reaction models. Enzymatic deconstruction of cellulosic materials is an exceedingly complex physico-chemical process. Models which elucidate specific mechanisms of deconstruction are often too computationally intensive to be accessible in process or multi-physics simulations, and empirical models are often too inflexible to be effectively applied outside of their batch contexts. In this paper, we employ a phenomenological modeling approach to represent rate slowdown due to substrate structure (implemented as two substrate phases) and feedback inhibition, and apply the model to a continuous reactor system. Results A phenomenological model was developed in order to predict glucose and solids concentrations in batch and continuous enzymatic-hydrolysis reactors from which liquor is continuously removed by ultrafiltration. A series of batch experiments were performed, varying initial conditions (solids, enzyme, and sugar concentrations), and best-fit model parameters were determined using constrained nonlinear least-squares methods. The model achieved a good fit for overall sugar yield and insoluble solids concentration, as well as for the reduced rate of sugar production over time. Additionally, without refitting model coefficients, good quantitative agreement was observed between results from continuous enzymatic-hydrolysis experiments and model predictions. Finally, the sensitivity of the model to its parameters is explored and discussed. Conclusions Although the phenomena represented by the model correspond to behaviors that emerge from clusters of mechanisms, and hence a set of model coefficients are unique to the substrate and the enzyme system, the model is efficient to solve and may be applied to novel reactor schema and implemented in computational fluid dynamics (CFD) simulations. Hence, this modeling approach finds the right balance between model complexity and computational efficiency. These capabilities have broad application to reactor design, scale-up, and process optimization.

09 BIOMASS FUELS↗

Steady Laminar Flame for 1-Step Thermal Decomposition Model of PBX 9501

We have recently developed a new 1-step thermal decomposition model of PBX 9501 high explosive. In this report, we examine the behavior of the model in 1-D steady laminar flame calculations. In particular, the dependencies of the steady laminar flame velocity on initial pressure, thermal conductivies and parameters of the thermal decomposition model are investigated. The results of our numerical calculations are compared to available experimental data.

42 ENGINEERING↗

Streamlining Ocean Dynamics Modeling with Fourier Neural Operators: A Multiobjective Hyperparameter and Architecture Optimization Approach

Training an effective deep learning model to learn ocean processes involves careful choices of various hyperparameters. We leverage DeepHyper’s advanced search algorithms for multiobjective optimization, streamlining the development of neural networks tailored for ocean modeling. The focus is on optimizing Fourier neural operators (FNOs), a data-driven model capable of simulating complex ocean behaviors. Selecting the correct model and tuning the hyperparameters are challenging tasks, requiring much effort to ensure model accuracy. DeepHyper allows efficient exploration of hyperparameters associated with data preprocessing, FNO architecture-related hyperparameters, and various model training strategies. We aim to obtain an optimal set of hyperparameters leading to the most performant model. Moreover, on top of the commonly used mean squared error for model training, we propose adopting the negative anomaly correlation coefficient as the additional loss term to improve model performance and investigate the potential trade-off between the two terms. The numerical experiments show that the optimal set of hyperparameters enhanced model performance in single timestepping forecasting and greatly exceeded the baseline configuration in the autoregressive rollout for long-horizon forecasting up to 30 days. Utilizing DeepHyper, we demonstrate an approach to enhance the use of FNO in ocean dynamics forecasting, offering a scalable solution with improved precision.

97 MATHEMATICS AND COMPUTING↗

Full-sky Models of Galactic Microwave Emission and Polarization at Subarcminute Scales for the Python Sky Model

Polarized foreground emission from the Galaxy is one of the biggest challenges facing current and upcoming cosmic microwave background (CMB) polarization experiments. We develop new models of polarized Galactic dust and synchrotron emission at CMB frequencies that draw on the latest observational constraints; that employ the “polarization fraction tensor” framework to couple intensity and polarization in a physically motivated way; and that allow for stochastic realizations of small-scale structure at subarcminute angular scales currently unconstrained by full-sky data. We implement these models into the publicly available Python Sky Model (PySM) software and additionally provide PySM interfaces to select models of dust and CO emission from the literature. We characterize the behavior of each model by quantitatively comparing it to observational constraints in both maps and power spectra, demonstrating an overall improvement over previous PySM models. Finally, we synthesize models of the various Galactic foreground components into a coherent suite of three plausible microwave skies that span a range of astrophysical complexity allowed by current data. Author contributions to this paper can be found at the end of this work.

Group, The Pan-Experiment Galactic Science↗

Continuum modeling of the mechanical and thermal behavior of discrete large structures

In the present paper we introduce a rather straightforward construction procedure in order to derive continuum equivalence of discrete truss-like repetitive structures. Once the actual structure is specified, the construction procedure can be outlined by the following three steps: (a) all sets of parallel members are identified, (b) unidirectional 'effective continuum' properties are derived for each of these sets and (c) orthogonal transformations are finally used to determine the contribution of each set to the 'overall effective continuum' properties of the structure. Here the properties includes mechanical (stiffnesses), thermal (coefficients of thermal expansions) and material densities. Once expanded descriptions of the steps (b) and (c) are done, the construction procedure will be applied to a wide variety of discrete structures and the results will be compared with those of other existing methods.

Nayfeh, A. H.↗

A renormalization group model for the stick-slip behavior of faults

A fault which is treated as an array of asperities with a prescribed statistical distribution of strengths is described. For a linear array the stress is transferred to a single adjacent asperity and for a two dimensional array to three ajacent asperities. It is shown that the solutions bifurcate at a critical applied stress. At stresses less than the critical stress virtually no asperities fail on a large scale and the fault is locked. At the critical stress the solution bifurcates and asperity failure cascades away from the nucleus of failure. It is found that the stick slip behavior of most faults can be attributed to the distribution of asperities on the fault. The observation of stick slip behavior on faults rather than stable sliding, why the observed level of seismicity on a locked fault is very small, and why the stress on a fault is less than that predicted by a standard value of the coefficient of friction are outlined.

Smalley, R. F., Jr.↗

Dynamical criterion for a marginally unstable, quasi-linear behavior in a two-layer model

A two-layer quasi-geostrophic flow forced by meridional variations in heating can be in regimes ranging from radiative equilibrium to forced geostrophic turbulence. Between these extremes is a regime where the time-mean (zonal) flow is marginally unstable. Using scaling arguments, it is concluded that such a marginally unstable state should occur when a certain parameter, measuring the strength of wave-wave interactions relative to the beta effect and advection by the thermal wind, is small. Numerical simulations support this proposal. A transition from the marginally unstable regime to a more nonlinear regime is then examined through numerical simulations with different radiative forcings. It is found that transition is not caused by secondary instability of waves in the marginally unstable regime. Instead, the time-mean flow can support a number of marginally unstable normal modes. These normal modes interact with each other, and if they are of sufficient amplitude, the flow enters a more nonlinear regime.

Ebisuzaki, W.↗