Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “snapshot”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

SlimIO: Lightweight I/O Path Design for Write Isolation in FDP-backed In-Memory Databases

In-Memory Databases (IMDBs) are widely used with HPC applications to manage transient data, often using snapshot-based persistence for backups. Redis, a representative IMDB, employs both snapshot and Write-Ahead Log (WAL) mechanisms, storing data on persistent devices via the traditional kernel I/O path. This method incurs syscall overhead, I/O contention between processes, and SSD garbage collection (GC) delays. To address these issues, we propose SlimIO, which adopts I/O passthru to minimize syscall overhead and inter-process I/O interference. Additionally, it leverages Flexible Data Placement (FDP) SSDs as backup storage to avoid performance degradation from SSD GC. Experimental results show that SlimIO reduces snapshot time by up to 25%, increases query throughput by up to 30% during non-snapshot periods, and lowers 99.9%-ile latency by up to 50%. Furthermore, it achieves a write amplification factor (WAF) of 1.00, indicating no redundant internal writes, thus extending SSD lifespan.

Lee, Sangyun [Sogang University]↗
NASA NTRS2018

Performance Calculations for a Boundary-Layer-Ingesting Fan Stage from Sparse Measurements

A test of the Boundary Layer Ingesting-Inlet / Distortion-Tolerant Fan was completed in NASA Glenn's 8-Foot by 6-Foot supersonic wind tunnel. Inlet and fan performance were measured by surveys using a set of rotating rake arrays upstream and downstream of the fan stage. Surveys were conducted along the 100 percent speed line and a constant exit corrected flow line passing through the aerodynamic design point. These surveys represented only a small fraction of the data collected during the test. For other operating points, data was recorded as snapshots without rotating the rakes which resulted in a sparser set of recorded data. This paper will discuss analysis of these additional, lower measurement density data points to expand our coverage of the fan map. Several techniques will be used to supplement the snapshot data at test conditions where survey data also exists. The supplemented snapshot data will be compared with survey results to assess the quality of the approach. Effective methods will be used to analyze the data set for which only snapshots exist.

fan efficiency↗
DOE OSTI2021

Correlator convolutional neural networks as an interpretable architecture for image-like quantum matter data

Image-like data from quantum systems promises to offer greater insight into the physics of correlated quantum matter. However, the traditional framework of condensed matter physics lacks principled approaches for analyzing such data. Machine learning models are a powerful theoretical tool for analyzing image-like data including many-body snapshots from quantum simulators. Recently, they have successfully distinguished between simulated snapshots that are indistinguishable from one and two point correlation functions. Thus far, the complexity of these models has inhibited new physical insights from such approaches. Here, we develop a set of nonlinearities for use in a neural network architecture that discovers features in the data which are directly interpretable in terms of physical observables. Applied to simulated snapshots produced by two candidate theories approximating the doped Fermi-Hubbard model, we uncover that the key distinguishing features are fourth-order spin-charge correlators. Our approach lends itself well to the construction of simple, versatile, end-to-end interpretable architectures, thus paving the way for new physical insights from machine learning studies of experimental and numerical data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Unraveling the intrinsic atomic physics behind x-ray absorption line shifts in warm dense silicon plasmas

Here, we present a novel free-energy density functional theory (DFT)-based methodology for optical property calculations of warm dense matter to cover a wide range of thermodynamic conditions and photon energies including the entire x-ray range. It uses Mermin–Kohn–Sham density functional theory with exchange-correlation (XC) thermal effects taken into account via a fully temperature dependent generalized gradient approximation XC functional. The methodology incorporates a combination of the ab initio molecular dynamics (AIMD) snapshotted Kubo–Greenwood optic data with a single-atom in simulation cell calculations to close the photon energy gap between the L and K edges and extend the K-edge tail toward many-keV photon energies. This gap arises in the standard scheme due to a prohibitively large number of bands required for the Kubo–Greenwood calculations with AIMD snapshots. Kubo–Greenwood data on snapshots provide an accurate description of optic properties at low photon frequencies slightly beyond the L-edge and x-ray absorption near edges structure (XANES) spectra, while data from periodic calculations with single atoms cover the tail regions beyond the edges. To demonstrate its applicability to mid-Z materials where the standard DFT-based approach is not computationally feasible, we have applied it to opacity calculations of warm dense silicon plasmas. These first-principles calculations revealed a very interesting phenomon of red-to-blue shift in K–L (1s → 2p) and K-edge absorptions along both isotherm and isochore, which are absent in most continuum-lowering models of traditional plasma physics. This new physics phenomenon can be attributed to the underlying competition between the screening of deeply bound core electrons and the screening of outer-shell electrons caused by warm-dense-plasma conditions. We further demonstrate that the ratio of 1s → 2p to the K-edge x-ray absorptions can be used to characterize warm-dense-plasma conditions. Eventually, based on our absorption calculations, we have established a first-principles opacity table (FPOT) for silicon in a wide range of material densities and temperatures.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Generative Ensemble Regression: Learning Particle Dynamics from Observations of Ensembles with Physics-informed Deep Generative Models

Here, we propose a new method for inferring the governing stochastic ordinary differential equations (SODEs) by observing particle ensembles at discrete and sparse time instants, i.e., multiple “snapshots.” Particle coordinates at a single time instant, possibly noisy or truncated, are recorded in each snapshot but are unpaired across the snapshots. By training a physics-informed generative model that generates “fake” sample paths, we aim to fit the observed particle ensemble distributions with a curve in the probability measure space, which is induced from the inferred particle dynamics. We employ different metrics to quantify the differences between distributions, e.g., the sliced Wasserstein distances and the adversarial losses in generative adversarial networks. We refer to this method as generative “ensemble-regression” (GER), in analogy to the classic “point-regression,” where we infer the dynamics by performing regression in the Euclidean space. We illustrate the GER by learning the drift and diffusion terms of particle ensembles governed by SODEs with Brownian motions and Lévy processes up to 100 dimensions. We also discuss how to treat cases with noisy or truncated observations. Apart from systems consisting of independent particles, we also tackle nonlocal interacting particle systems with unknown interaction potential parameters by constructing a physics-informed loss function. Finally, we investigate scenarios of paired observations and discuss how to reduce the dimensionality in such cases by proving a convergence theorem that provides theoretical support.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

An Optimization-Based Coupling of Reduced Order Models with an Efficient Reduced Adjoint Basis Generation Approach

Optimization-based coupling (OBC) is an attractive alternative to traditional Lagrange multiplier approaches in multiple modeling and simulation contexts. However, application of OBC to time-dependent problems has been hindered by the computational cost of finding the stationary points of the associated Lagrangian, which requires primal and adjoint solves. This issue can be mitigated by using OBC in conjunction with computationally efficient reduced order models (ROMs). To demonstrate the potential of this combination, in this paper, we develop an optimization-based ROM-ROM coupling for a transient advection-diffusion transmission problem. We pursue the “optimize-then-reduce” path toward solving the minimization problem at each time step and solve reduced space adjoint system of equations, where the main challenge in this formulation is the generation of adjoint snapshots and reduced bases for the adjoint systems required by the optimizer. One of the main contributions of the paper is a new technique for an efficient adjoint snapshot collection for gradient-based optimizers in the context of optimization-based ROM-ROM couplings. In conclusion, we present numerical studies demonstrating the accuracy of the approach along with comparison between various approaches for selecting a reduced order basis for the adjoint systems, including decay of snapshot energy, average iteration counts, and timings.

coupled problems↗
DOE OSTI2022

Sweep-tracing algorithm: in silico slip crystallography and tension-compression asymmetry in BCC metals

Abstract Direct Molecular Dynamics (MD) simulations are being increasingly employed to model dislocation-mediated crystal plasticity with atomic resolution. Thanks to the dislocation extraction algorithm (DXA), dislocation lines can be now accurately detected and positioned in space and their Burgers vector unambiguously identified in silico, while the simulation is being performed. However, DXA extracts static snapshots of dislocation configurations that by themselves present no information on dislocation motion. Referred to as a sweep-tracing algorithm (STA), here we introduce a practical computational method to observe dislocation motion and to accurately quantify its important characteristics such as preferential slip planes (slip crystallography). STA reconnects pairs of successive snapshots extracted by DXA and computes elementary slip facets thus precisely tracing the motion of dislocation segments from one snapshot to the next. As a testbed for our new method, we apply STA to the analysis of dislocation motion in large-scale MD simulations of single crystal plasticity in BCC metals. We observe that, when the crystal is subjected to uniaxial deformation along its [001] axis, dislocation slip predominantly occurs on the {112} maximum resolved shear stress plane under tension, while in compression slip is non-crystallographic (pencil) resulting in asymmetric mechanical response. The marked contrast in the observed slip crystallography is attributed to the twinning/anti-twinning asymmetry of shears in the {112} planes relatively favoring dislocation motion in the twinning sense while hindering dislocations from moving in the anti-twinning directions.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Unraveling Hidden Order and Dynamics in a Heterogeneous Ferroelectric System Using Machine Learning

We uploaded two batches of datasets: Batch-a) Equilibrium dynamics at a constant temperature at zero electric-field, with one trajectory each for 4-different defect structures (i.e. SETs 1 to 4). Each trajectory has a time-step of 0.25 fs, and is run for 7775000 time-steps, with snapshots written out every 4 time-steps (i.e. every 1fs); and Batch-b) Non-Equilibrium dynamics at a constant temperature with the same 0.25 fs time-step, but data dumped every 500 times-steps (i.e. every 125fs) for each of the SETs. The total trajectory of each defect structure (i.e. each SETs 1 to 4) is 2800000 time-steps (5600 snapshots), with stepping of electric-field by 0.01 V/Ã…, after every 100,000 time-steps (i.e. every 200 snapshots), from E=0 to E=0.05 V/Ã… to E = -0.05 V/Ã… to E=0.05 V/Ã….

36 MATERIALS SCIENCE↗
NASA NTRS1991

Fault detection and isolation for multisensor navigation systems

Increasing attention is being given to the problem of erroneous measurement data for multisensor navigation systems. A recursive estimator can be used in conjunction with a 'snapshot' batch estimator to provide fault detection and isolation (FDI) for these systems. A recursive estimator uses past system states to form a new state estimate and compares it to the calculated state based on a new set of measurements. A 'snapshot' batch estimator uses a set of measurements collected simultaneously and compares solutions based on subsets of measurements. The 'snapshot' approach requires redundant measurements in order to detect and isolate faults. FDI is also referred to as Receiver Autonomous Integrity Monitoring (RAIM).

Kline, Paul A.↗
NASA NTRS1993

Optimal thresholds for the estimation of area rain-rate moments by the threshold method

Optimization of the threshold method, achieved by determination of the threshold that maximizes the correlation between an area-average rain-rate moment and the area coverage of rain rates exceeding the threshold, is demonstrated empirically and theoretically. Empirical results for a sequence of GATE radar snapshots show optimal thresholds of 5 and 27 mm/h for the first and second moments, respectively. Theoretical optimization of the threshold method by the maximum-likelihood approach of Kedem and Pavlopoulos (1991) predicts optimal thresholds near 5 and 26 mm/h for lognormally distributed rain rates with GATE-like parameters. The agreement between theory and observations suggests that the optimal threshold can be understood as arising due to sampling variations, from snapshot to snapshot, of a parent rain-rate distribution. Optimal thresholds for gamma and inverse Gaussian distributions are also derived and compared.

Short, David A.↗
NASA NTRS2005

Reduced-Order Modeling of a Heaving Airfoil

A reduced-order model of a flapping airfoil is developed using Proper Orthogonal Decomposition (POD). The proper basis functions, developed from snapshots of full Navier-Stokes simulations, are used for a Galerkin projection of the governing equations. The resulting coupled, nonlinear ordinary di.erential equations have a low dimension because the first few basis members capture most of the energy of the flow. The reduced-order model is used to simulate heaving motions that are both similar to and different from the motion(s) used to generate the basis functions, and the errors in the model are quantified. Several methods are used to generate mode sets that can be used over a range of heaving parameters, including snapshots from one, two, and multiple Navier-Stokes simulations. As snapshots from additional simulations are added to the decomposition, the mode sets become richer and can simulate a wider range of parameter space, at some computational cost. Whereas the POD method is fully applicable in three dimensions, the simulation technique based on a body-fixed and body-fitted grid suffers large overhead when extended to three dimensions. To reduce the overhead, an embedding technique is discussed which embeds the solid wing into a fixed Cartesian grid. The wing, which can now have multiple pieces and also be flexible, is represented by a distribution of body forces. This distribution is determined to give exactly the flow around a flapping wing.

Haj-Hariri, H.↗
NASA NTRS2005

Stroboscopic Goggles for Reduction of Motion Sickness

A device built around a pair of electronic shutters has been demonstrated to be effective as a prototype of stroboscopic goggles or eyeglasses for preventing or reducing motion sickness. The momentary opening of the shutters helps to suppress a phenomenon that is known in the art as retinal slip and is described more fully below. While a number of different environmental factors can induce motion sickness, a common factor associated with every known motion environment is sensory confusion or sensory mismatch. Motion sickness is a product of misinformation arriving at a central point in the nervous system from the senses from which one determines one s spatial orientation. When information from the eyes, ears, joints, and pressure receptors are all in agreement as to one s orientation, there is no motion sickness. When one or more sensory input(s) to the brain is not expected, or conflicts with what is anticipated, the end product is motion sickness. Normally, an observer s eye moves, compensating for the anticipated effect of motion, in such a manner that the image of an object moving relatively to an observer is held stationary on the retina. In almost every known environment that induces motion sickness, a change in the gain (in the signal-processing sense of gain ) of the vestibular system causes the motion of the eye to fail to hold images stationary on the retina, and the resulting motion of the images is termed retinal slip. The present concept of stroboscopic goggles or eyeglasses (see figure) is based on the proposition that prevention of retinal slip, and hence, the prevention of sensory mismatch, can be expected to reduce the tendency toward motion sickness. A device according to this concept helps to prevent retinal slip by providing snapshots of the visual environment through electronic shutters that are brief enough that each snapshot freezes the image on each retina. The exposure time for each snapshot is less than 5 ms. In the event that a higher rate of strobing is necessary for adequate viewing of the changing scene during rapid head movements, the rate of strobing (but not the exposure time) can be controlled in response to the readings of rate-of-rotation sensors attached to the device.

Reschke, M. F.↗
NASA NTRS2015

The Open Data Repository's Data Publisher

We have quickly gathered a diverse set of databases that have significant activity. Researchers are using them on a daily basis from collection through all phases of research. Focus on: (1) Linked data and semantic web integration are fundamental to our long term plans. (2) Citation system is critical before our first full release. Snapshot-based citation generation for data sets or objects. As we expand our feature set, expect the system will: (1) Provide a very high level of provenance for any data housed in the software. (2) Make data management beneficial to the researcher throughout the research process. (3) Create living archives that allow citable snapshots of data and summaries of the changes since the snapshot was created.

Stone, N.↗
DOE OSTI2021

Malware analysis and recovery

A system and method detects malware by processing notifications from an intrusion detection system and baseline snapshots from an image capture utility. The image capture utility constructs an image of the suspected malware intrusion and links the suspected malware intrusion to the baseline snapshots. The system and method propagates the image of the suspected malware intrusion across multiple networks before it distinguishes malicious code, device state, and files from benign code, device state, and files. Some systems and methods include a malware recovery system that executes machine learning instructions and heuristics to revert a client and/or a remote server to one or more baseline snapshots.

Smith, Jared M.↗
DOE OSTI2020

Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification

Scientists are increasingly using volunteer efforts of citizen scientists to classify images captured by motion-activated trail cameras. The rising popularity of citizen science reflects its potential to engage the public in conservation science and accelerate processing of the large volume of images generated by trail cameras. While image classification accuracy by citizen scientists can vary across species, the influence of other factors on accuracy is poorly understood. Inaccuracy diminishes the value of citizen science derived data and prompts the need for specific best-practice protocols to decrease error. We compare the accuracy between three programs that use crowdsourced citizen scientists to process images online: Snapshot Serengeti, Wildwatch Kenya, and AmazonCam Tambopata. We hypothesized that habitat type and camera settings would influence accuracy. To evaluate these factors, each photograph was circulated to multiple volunteers. All volunteer classifications were aggregated to a single best answer for each photograph using a plurality algorithm. Subsequently, a subset of these images underwent expert review and were compared to the citizen scientist results. Classification errors were categorized by the nature of the error (e.g., false species or false empty), and reason for the false classification (e.g., misidentification). Our results show that Snapshot Serengeti had the highest accuracy (97.9%), followed by AmazonCam Tambopata (93.5%), then Wildwatch Kenya (83.4%). Error type was influenced by habitat, with false empty images more prevalent in open-grassy habitat (27%) compared to woodlands (10%). For medium to large animal surveys across all habitat types, our results suggest that to significantly improve accuracy in crowdsourced projects, researchers should use a trail camera set up protocol with a burst of three consecutive photographs, a short field of view, and determine camera sensitivity settings based on in situ testing. Accuracy level comparisons such as this study can improve reliability of future citizen science projects, and subsequently encourage the increased use of such data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Using discrete Bayesian networks for diagnosing and isolating cross-level faults in HVAC systems

Fault detection and diagnosis (FDD) technologies are critical to ensure satisfactory building performance, such as reducing energy wastes and negative impacts on occupant comfort and productivity. Existing FDD technologies mainly focus on component-level FDD solutions, which could lead to mis-diagnosis of cross-level faults in heating, ventilating, and air-conditioning (HVAC) systems. Cross-level faults are those faults that occur in one component or subsystem, but cause operational abnormalities in other components or subsystems, and result in a building level performance degradation. How to effectively diagnose the root cause of a cross-level fault is the focus of this study. Here, this paper presents a novel discrete Bayesian Network (DisBN)-based method for diagnosing cross-level faults in an HVAC system commonly used in commercial buildings. A two-level DisBN structure model is developed in this study. The parameters used in the DisBN model are obtained either from expert knowledge or through machine-learning strategies from normal system operation data. Meanwhile, the probability parameters are discretized to incorporate the uncertainties associated with typical expert knowledge. Thus, the developed DisBN method addresses the challenges many other BN based FDD methods face, i.e., the lack of fault data for BN parameter training. The developed DisBN represents causal relationships between a fault and its cross-level system impacts (i.e., fault symptoms or fault indicators) by considering how fault impacts propagate across different levels in an HVAC system. A weather and schedule information-based Pattern Matching (WPM) method is employed to automatically create WPM baseline data sets for each incoming real time snapshot data from the building systems. Consequently, BN inference and real-time diagnostics are achieved by comparing incoming snapshot data and the WPM baseline data set. The proposed method is evaluated using experimental fault data collected in a campus building. Fault diagnosis results demonstrate that the WPM-DisBN method is effective at locating the root causes of cross-level faults in an HVAC system.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

A fast and accurate domain decomposition nonlinear manifold reduced order model

Here, this paper integrates nonlinear-manifold reduced order models (NM-ROMs) with domain decomposition (DD). NM ROMs approximate the full order model (FOM) state in a nonlinear-manifold by training a shallow, sparse autoencoder using FOM snapshot data. These NM-ROMs can be advantageous over linear-subspace ROMs (LS-ROMs) for problems with slowly decaying Kolmogorov n-width. However, the number of NM-ROM parameters that need to be trained scales with the size of the FOM. Moreover, for “extreme-scale” problems, the storage of high-dimensional FOM snapshots alone can make ROM training expensive. To alleviate the training cost, this paper applies DD to the FOM, computes NM-ROMs on each subdomain, and couples them to obtain a global NM-ROM. This approach has several advantages: Subdomain NM-ROMs can be trained in parallel, involve fewer parameters to be trained than global NM-ROMs, require smaller subdomain FOM dimensional training data, and can be tailored to subdomain specific features of the FOM. The shallow, sparse architecture of the autoencoder used in each subdomain NM-ROM allows application of hyper-reduction (HR), reducing the complexity caused by nonlinearity and yielding computational speedup of the NM-ROM. This paper provides the first application of NM-ROM (with HR) to a DD problem. In particular, this paper details an algebraic DD reformulation of the FOM, training a NM-ROM with HR for each sub domain, and a sequential quadratic programming (SQP) solver to evaluate the coupled global NM-ROM. Theoretical convergence results for the SQP method and a priori and a posteriori error estimates for the DD NM-ROM with HR are provided. The proposed DD NM-ROM with HR approach is numerically compared to a DD LS-ROM with HR on the 2D steady-state Burgers’ equation, showing an order of magnitude improvement in accuracy of the proposed DD NM-ROM over the DD LS-ROM.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Identifying and tracking bubbles and drops in simulations: A toolbox for obtaining sizes, lineages, and breakup and coalescence statistics

Knowledge of bubble and drop size distributions in two-phase flows is important for characterizing a wide range of phenomena, including combustor ignition, sonar communication, and cloud formation. The physical mechanisms driving the background flow also drive the time evolution of these distributions. Accurate and robust identification and tracking algorithms for the dispersed phase are necessary to reliably measure this evolution and thereby quantify the underlying mechanisms in interface-resolving flow simulations. The identification of individual bubbles and drops traditionally relies on an algorithm used to identify connected regions. This traditional algorithm can be sensitive to the presence of spurious structures. A cost-effective refinement is proposed to maximize volume accuracy while minimizing the identification of spurious bubbles and drops. An accurate identification scheme is crucial for distinguishing bubble and drop pairs with large size ratios. The identified bubbles and drops need to be tracked in time to obtain breakup and coalescence statistics that characterize the evolution of the size distribution, including breakup and coalescence frequencies, and the probability distributions of parent and child bubble and drop sizes. An algorithm based on mass conservation is proposed to construct bubble and drop lineages using simulation snapshots that are not necessarily from consecutive time steps. These lineages are then used to detect breakup and coalescence events, and obtain the desired statistics. Accurate identification of large-size-ratio bubble and drop pairs enables accurate detection of breakup and coalescence events over a large size range. Accurate detection of successive breakup and coalescence events requires that the snapshot interval be an order of magnitude smaller than the characteristic breakup and coalescence times to capture these successive events while minimizing the identification of repeated confounding events. Together, these algorithms serve as a toolbox for detailed analysis of two-phase simulations, and enable insights into the mechanisms behind bubble and drop formation and evolution in flows of practical importance.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗