Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data representations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

The Sensitivity of Simulated Ocean Biogeochemistry to Forcing Fields Derived from NCEP and MERRA Reanalysis Products

Ocean biogeochemistry models are typically forced by atmospheric and oceanic data derived from reanalysis products. For the NASA Ocean Biogeochemistry Model (NOBM) such reanalysis forcing fields include: surface wind stress, sea surface temperature, ice distributions, shortwave radiation, surface wind speeds and surface atmospheric pressure. Additionally, proper computation of ocean irradiance requires reanalysis products of relative humidity and precipitable water (in addition to aerosol and cloud information which is derived from satellite data). The question posed here is, does the choice of reanalysis products make a difference in the representation of ocean biology and biogeochemistry? NOBM was forced by NCEP and MERRA reanalysis products for the period 2002-2009. We find that in 2009 global distributions and abundances of biological variables (total chlorophyll and nutrients) and carbon (dissolved inorganic and organic carbon and surface pCO2) were similar between the two different forcing fields. Global statistical comparisons with satellite and in situ data also showed negligible differences.

Gregg, Watson↗

Learning Memento archive routing with Character-based Artificial Neural Networks

This white paper describes a series of tests that were performed to determine if a neural network could learn patterns from a service that maintains a cache of routing decisions for the discovery of version information for discrete web-at-large URLs. Labeled training data was derived from a log file that records the by-archive availability of Memento availability for a given URL. Training data sets were generated from this log file on a by-archive basis (thus making it a binary classification problem). Each training data set consisted of equal numbers of hit and miss URLs, selected at random. The URLs were converted to a normalized numeric representation where each integer in a URL training vector represents a character in that URL. The corresponding label indicates whether or not Mementos were available for that URL in the selected archive. The training data matrix and the label vector became input to a neural network. A number of neural network architectures and network hyperparameters were explored, however the log entries themselves were used as-is, without any feature engineering, beyond the aforementioned normalization.

97 MATHEMATICS AND COMPUTING↗

Mining for Strong Gravitational Lenses with Self-supervised Learning

We employ self-supervised representation learning to distill information from 76 million galaxy images from the Dark Energy Spectroscopic Instrument Legacy Imaging Surveys’ Data Release 9. Targeting the identification of new strong gravitational lens candidates, we first create a rapid similarity search tool to discover new strong lenses given only a single labeled example. We then show how training a simple linear classifier on the self-supervised representations, requiring only a few minutes on a CPU, can automatically classify strong lenses with great efficiency. We present 1192 new strong lens candidates that we identified through a brief visual identification campaign and release an interactive web-based similarity search tool and the top network predictions to facilitate crowd-sourcing rapid discovery of additional strong gravitational lenses and other rare objects: github.com/georgestein/ssl-legacysurvey.

79 ASTRONOMY AND ASTROPHYSICS↗

Visualizing the semantic content of large text databases using text maps

A methodology for generating text map representations of the semantic content of text databases is presented. Text maps provide a graphical metaphor for conceptualizing and visualizing the contents and data interrelationships of large text databases. Described are a set of experiments conducted against the TIPSTER corpora of Wall Street Journal articles. These experiments provide an introduction to current work in the representation and visualization of documents by way of their semantic content.

Combs, Nathan↗

Representation of the Geosynchronous Plasma Environment in Spacecraft Charging Calculations

Historically, our ability to predict and postdict spacecraft surface charging has been limited by the characterization of the plasma environment. One difficulty lies in the common practice of fitting the plasma data to a Maxwellian or Double Maxwellian distribution function, which may not represent the data well for charging purposes. We use electron and ion flux spectra measured by the Los Alamos National Laboratory (LANL) Magnetospheric Plasma Analyzer (MPA) to examine how the use of different spectral representations of the charged particle environment in computations of spacecraft potentials during magnetospheric substorms affects the accuracy of the results. We calculate the spacecraft potential using both the measured fluxes and several different fits to these fluxes. These measured fluxes have been corrected for the difference between the measured and calculated potential. The potential computed using the measured fluxes and the best available material properties of graphite carbon, with a secondary electron escape fraction of 81%, is within a factor of three of the measured potential for 87% of the data. Potentials calculated using a Kappa function fit to the incident electron flux distribution function and a Maxwellian function fit to the incident ion flux distribution function agree with measured potentials nearly as well as do potentials calculated using the measured fluxes. Alternative spectral representations gave less accurate estimates of potential. The use of all the components of the net flux, along with spacecraft specific average material properties, gives a better estimate of the spacecraft potential than the high energy flux alone.

Davis, V. A.↗

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Tracking cropland transitions: A comparative analysis of U.S. land cover change data

There are a growing number of land cover data available for the conterminous United States, supporting various applications ranging from biofuel regulatory decisions to habitat conservation assessments. These datasets vary in their source information, frequency of data collection and reporting, land class definitions, categorical detail, and spatial scale and time intervals of representation. These differences limit direct comparison, contribute to disagreements among studies, confuse stakeholders, and hamper our ability to confidently report key land cover trends in the U.S. Here we assess changes in cropland derived from the Land Change Monitoring, Assessment, and Projection (LCMAP) dataset from the U.S. Geological Survey and compare them with analyses of three established land cover datasets across the coterminous U.S. from 2008-2017: (1) the National Resources Inventory (NRI), (2) a dataset Lark et al. 2020 derived from the Cropland Data Layer (CDL), and (3) a dataset from Potapov et al. 2022. LCMAP reports more stable cropland and less stable noncropland in all comparisons, likely due to its more expansive definition of cropland which includes managed grasslands (pasture and hay). Despite these differences, net cropland expansion from all four datasets was comparable (5.18-6.33 million acres), although the geographic extent and type of conversion differed. LCMAP projected the largest cropland expansion in the southern Great Plains, whereas other datasets projected the largest expansion in the northwestern and central Midwest. Most of the pixel-level disagreements (86%) between LCMAP and Lark et al. 2020 were due to definitional differences among datasets, whereas the remainder (14%) were from a variety of causes. Cropland expansion in the LCMAP likely reflects conversions of more natural areas, whereas cropland expansion in other data sources also captures conversion of managed pasture to cropland. The particular research question considered (e.g., habitat versus soil carbon) should influence which data source is more appropriate.

60 APPLIED LIFE SCIENCES↗

The state of the atmosphere as inferred from the FGGE satellite observing systems during SOP-1

Data assimilation experiments were performed to test the influence of different elements of the satellite observing systems. Results from some of the experiments are presented. These findings show that the FGGE satellite systems are able to infer the three-dimensional motion field and improve the representation of the large-scale state of the atmosphere. Preliminary results of the forecast impact of the FGGE data sets are also presented.

Halem, M.↗

Toward particle accelerator machine state embeddings as a modality for large language models

Understanding and diagnosing the state of a particle accelerator requires navigating high-dimensional control system data, often involving hundreds of interdependent parameters. We propose a novel multimodal embedding framework that jointly learns representations of machine states from both numerical control system readouts and natural language descriptions. This enables the translation of complex machine conditions into human-readable summaries while maintaining fidelity to the underlying physical system. The obtained embeddings are subsequently adapted to an open-weights large language model via cross-attention conditioning. We demonstrate a first implementation trained on European XFEL machine state data. This work covers the embedding model architecture, training methodology, and presents initial examples demonstrating the model's capabilities in action. Due to the general concept of machine state, the model can be easily adapted to other facilities and control system environments.

Accelerator Physics↗

BI-sparsity pursuit for robust subspace recovery

Here, the success of sparse models in computer vision and machine learning in many real-world applications, may be attributed in large part, to the fact that many high dimensional data are distributed in a union of low dimensional subspaces. The underlying structure may, however, be adversely affected by sparse errors, thus inducing additional complexity in recovering it. In this paper, we propose a bi-sparse model as a framework to investigate and analyze this problem, and provide as a result , a novel algorithm to recover the union of subspaces in presence of sparse corruptions. We additionally demonstrate the effectiveness of our method by experiments on real-world vision data.

47 OTHER INSTRUMENTATION↗

Coordinate-Based Seismic Interpolation in Irregular Land Survey: A Deep Internal Learning Approach

Physical and budget constraints often result in irregular sampling, which complicates accurate subsurface imaging. Preprocessing approaches, such as missing trace or shot interpolation, are typically employed to enhance seismic data in such cases. Recently, deep learning has been used to address the trace interpolation problem at the expense of large amounts of training data to adequately represent typical seismic events. Nonetheless, most research in this area has focused on trace reconstruction, with little attention having been devoted to shot interpolation. Furthermore, existing methods assume regularly spaced receivers/sources failing in approximating seismic data from real (irregular) surveys. This work presents a novel shot gather interpolation approach which uses a continuous coordinate-based representation of the acquired seismic wavefield parameterized by a neural network. The proposed unsupervised approach, which we call coordinate-based seismic interpolation (CoBSI), enables the prediction of specific seismic characteristics in irregular land surveys without using external data during neural network training. Importantly, experimental results on real and synthetic 3-D data validate the ability of the proposed method to estimate continuous smooth seismic events in the time-space and frequency-wavenumber domains, improving sparsity or low-rank-based interpolation methods.

58 GEOSCIENCES↗

LandScan Mosaic

The LandScan program at Oak Ridge National Laboratory (ORNL), in collaboration with the National Geospatial-Intelligence Agency (NGA), continues to deliver the most accurate and up to date global, high resolution gridded population data. Additionally, the latest advancements in the LandScan HD methodology led to reduced latency in development of rapid updates for geopolitical events. With momentum towards reporting more up to date population estimates, feedback from the user community expressed interest in reporting population estimates in ranges - whether to express a level of uncertainty or confirm to leadership and stakeholders the modeled data are estimates. Building upon the need to understand uncertainty or confidence in the modeled data and report ranges at the global scale, LandScan Mosaic was developed. LandScan Mosaic represents the next generation of high-resolution population modeling, building upon the established success of previous LandScan HD iterations. While LandScan HD employed a deterministic big data fusion approach, LandScan Mosaic enhances this methodology by integrating advanced machine learning techniques to impute missing, yet crucial, population model parameters. This advancement allows for probabilistic modeling of building occupancy and population distribution, incorporating uncertainty quantification through Monte Carlo sampling methods. By combining big data fusion with machine learning-driven imputation and stochastic modeling, LandScan Mosaic provides a more comprehensive and robust representation of population dynamics. LandScan Mosaic will be following the in the footsteps of its longstanding counterpart LandScan Global and releasing a global gridded population raster, at the 3-arcsecond resolution. This technical report documents the current stage of development of LandScan Mosaic, detailing the methodologies and data sources behind the modeling. Stakeholders are encouraged to use this document as an authoritative reference for insight into Mosaic’s data development processes. However, readers should note that LandScan Mosaic remains in a late-stage research and development phase, and methodologies and data presented here are subject to refinements ahead of the anticipated global release in Summer 2025. Feedback and inquiries from users and stakeholders are welcomed as we continue to refine and enhance this important population resource.

97 MATHEMATICS AND COMPUTING↗

Comparing Model Representations of Physiological Limits on Transpiration at a Semi-arid Ponderosa Pine Site

Mechanistic representations of biogeochemical processes in ecosystem models are rapidly advancing, requiring advancements in model evaluation approaches. Here we quantify multiple aspects of model functional performance to evaluate improved process representations in ecosystem models. We compare semi-empirical stomatal models with hydraulic constraints against more mechanistic representations of stomatal and hydraulic functioning at a semi-arid pine site using a suite of metrics and analytical tools. We find that models generally perform similarly under unstressed conditions, but performance diverges under atmospheric and soil drought. The more empirical models better capture synergistic information flows between soil water potential and vapor pressure deficit to transpiration, while the more mechanistic models are overly deterministic. Although models can be parameterized to yield similar functional performance, alternate parameterizations could not overcome structural model constraints that underestimate the unique information contained in soil water potential about transpiration. Additionally, both multilayer canopy and big-leaf models were unable to capture the magnitude of canopy temperature divergence from air temperature, and we demonstrate that errors in leaf temperature can propagate to considerable error in simulated transpiration. This study demonstrates the value of merging underutilized observational data streams with emerging analytical tools to characterize ecosystem function and discriminate among model process representations.

54 ENVIRONMENTAL SCIENCES↗

End-to-End Jet Classification of Boosted Top Quarks with CMS Open Data

We describe a novel application of the end-to-end deep learning technique to the task of discriminating top quark-initiated jets from those originating from the hadronization of a light quark or a gluon. The end-to-end deep learning technique combines deep learning algorithms and low-level detector representation of the high-energy collision event. In this study, we use lowlevel detector information from the simulated CMS Open Data samples to construct the top jet classifiers. To optimize classifier performance we progressively add low-level information from the CMS tracking detector, including pixel detector reconstructed hits and impact parameters, and demonstrate the value of additional tracking information even when no new spatial structures are added. Relying only on calorimeter energy deposits and reconstructed pixel detector hits, the end-to-end classifier achieves a ROC-AUC score of 0.975±0.002 for the task of classifying boosted top quark jets. After adding derived track quantities, the classifier ROC-AUC score increases to 0.9824±0.0013, serving as the first performance benchmark for these CMS Open Data samples.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Biogeochemistry simulations for the Salt Marsh Accretion Response to Temperature eXperiment (SMARTX)

Coastal ecosystems have been largely ignored in Earth system models but are important zones for carbon and nutrient processing. Interactions between water, microbes, soil, sediments, and vegetation are important for mechanistic representation of coastal processes and ecosystem function. To investigate the role of these feedbacks, we used a reactive transport model (PFLOTRAN) that has the capability to be connected to the Energy Exascale Earth System Model (E3SM). PFLOTRAN was used to incorporate redox reactions and track chemical species important for coastal ecosystems as well as define simple representations of vegetation dynamics. Our goal was to incorporate oxygen flux, salinity, pH, sulfur cycling, and methane production along with plant-mediated transport of gases and tidal flux. Using porewater profile and incubation data for model calibration and evaluation, we were able to create depth-resolved biogeochemical soil profiles for saltmarsh habitat and use this updated representation to simulate direct and indirect effects of elevated CO2 and temperature on subsurface biogeochemical cycling. We found that simply changing the partial pressure of CO2 or increasing temperature in the model did not fully reproduce observed changes in the porewater profile, but the inclusion of plant or microbial responses to CO2 and temperature manipulations was more accurate in representing porewater concentrations. This indicates the importance of characterizing tightly coupled vegetation-subsurface processes for developing predictive understanding and the need for measurement of plant-soil interactions on the same time scale to understand how hotspots or moments are generated.Included in this data package are PFLOTRAN input (PFLOTRAN input files and chemical database) files for simulating single column biogeochemistry, root, and tide interactions at the Global Change Research Wetland (Kirkpatrick Marsh; Edgewater, MD). The biogeochemical network includes soil organic matter decomposition, nitrogen, iron, and sulfur cycling, and methanogenesis. Reduced species can be oxidized and plant processes include oxygen and nutrient priming, methane release, and nutrient uptake.Inputs:TAI_database.dat - geochemical database for reactions, more information on database structure and variables can be found here https://www.pflotran.org/documentation/user_guide/cards/pages/geochemical_database.htmlswamp.in - input file for biogeochemical network in PFLOTRANswamp_eCO2.in - input file for biogeochemical network in PFLOTRAN with input gas partial pressures/concentrations adjusted for elevated CO2 treatmentsOutputs:swamp_obs_0.tec - hourly porewater concentrations from from multiple depths in the soil columnswamp_eCO2_obs_0.tec - hourly porewater concentrations from multiple depths in the soil column for elevated CO2 treatmentsPFLOTRAN code access: https://github.com/fmyuan/pflotran-elm-interface.git

54 ENVIRONMENTAL SCIENCES↗

Knowledge engineering for temporal dependency networks as operations procedures

This paper presents a case study of the knowledge engineering process employed to support the Link Monitor and Control Operator Assistant (LMCOA). The LMCOA is a prototype system which automates the configuration, calibration, test, and operation (referred to as precalibration) of the communications, data processing, metric data, antenna, and other equipment used to support space-ground communications with deep space spacecraft in NASA's Deep Space Network (DSN). The primary knowledge base in the LMCOA is the Temporal Dependency Network (TDN), a directed graph which provides a procedural representation of the precalibration operation. The TDN incorporates precedence, temporal, and state constraints and uses several supporting knowledge bases and data bases. The paper provides a brief background on the DSN, and describes the evolution of the TDN and supporting knowledge bases, the process used for knowledge engineering, and an analysis of the successes and problems of the knowledge engineering effort.

Fayyad, Kristina E.↗

Structure of the atmosphere of Jupiter from Pioneer 10 and 11 radio occultation measurements

A technique for incorporating effects of the oblateness of Jupiter's atmosphere into the data analysis procedure for radio-occultation measurements is described which makes use of a spherical harmonic representation of the gravity field to compute the shape of the planet. With this technique, the center of refraction is located by the radius of curvature and the normal direction at the closest approach point of the ray. The present technique, a subsequent approximation involving the use of a constant center of refraction, and the Abel integral transform inversion method for spherical planets are applied to Pioneer 10 and 11 data. All the intermediate results obtained show a temperature inversion between 10 and 100 mb, with temperatures from 130 to 170 K at 10 mb and from 80 to 120 K at 100 mb. Comparison of the radio-occultation profiles with radiative-convective equilibrium models and the temperature profile based on Pioneer 10 IR radiometer data indicates good agreement between the models and the occultation results.

Kliore, A. J.↗

Three-dimensional ultrasonic imaging of concrete elements using different SAFT data acquisition and processing schemes

Ultrasonic testing systems using transducer arrays and the SAFT (Synthetic Aperture Focusing Technique) reconstruction allow for imaging the internal structure of concrete elements. At one-sided access, three-dimensional representations of the concrete volume can be reconstructed in relatively great detail, permitting to detect and localize objects such as construction elements, built-in components, and flaws. Different SAFT data acquisition and processing schemes can be utilized which differ in terms of the measuring and computational effort and the reconstruction result. In this contribution, two methods are compared with respect to their principle of operation and their imaging characteristics. The first method is the conventional single-channel SAFT algorithm which is implemented using a virtual transducer that is moved within a transducer array by electronic switching. The second method is the Combinational SAFT algorithm (C-SAFT), also named Sampling Phased Array (SPA) or Full Matrix Capture/Total Focusing Method (TFM/FMC), which is realized using a combination of virtual transducers within a transducer array. Five variants of these two methods are compared by means of measurements obtained at test specimens containing objects typical of concrete elements. The automated SAFT imaging system FLEXUS is used for the measurements which includes a three-axis scanner with a 1.0 m × 0.8 m scan range and an electronically switched ultrasonic array consisting of 48 transducers in 16 groups. On the basis of two-dimensional and three-dimensional reconstructed images, qualitative and some quantitative results of the parameters image resolution, signal-to-noise ratio, measurement time, and computational effort are discussed in view of application characteristics of the SAFT variants.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗