Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Retrieval Algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

AWAKEN 2023 CLAMPS2 AERI TROPoe Retrievals

These files contain 24 hour periods of retrieved thermodynamic profiles derived from observations collected by the CLAMPS2 Atmospheric Emitted Radiance Interferometer (AERI). The TROPoe algorithm is a python equivalent to the AERIoe algorithm (see Turner and Loehnert, 2014; Turner and Blumberg 2019). These data were collected during the AWAKEN project. AERI only data is available.

54 ENVIRONMENTAL SCIENCES↗

AWAKEN 2023 CLAMPS1 AERI TROPoe Retrievals

These files contain 24 hour periods of retrieved thermodynamic profiles derived from observations collected by the CLAMPS1 Atmospheric Emitted Radiance Interferometer (AERI). The TROPoe algorithm is a python equivalent to the AERIoe algorithm (see Turner and Loehnert 2014; Turner and Blumberg 2019). These data were collected during the AWAKEN project. AERI only data is available.

54 ENVIRONMENTAL SCIENCES↗

Using a Large Language Model for Accurate Technical Language Generation in the Predictive Maintenance of Circulating Water Systems in Nuclear Power Plants

Machine learning (ML) methods for predictive maintenance (PdM) are emerging as effective proactive strategies for diagnosing equipment degradation and enabling effective decision-making. However, explainability and trustworthiness of artificial intelligence are two salient challenges that need to be addressed for wider deployment of these technologies in nuclear power plants (NPPs). Large language models (LLMs) offer a unique approach to tackle these challenges by explaining PdM, work orders, diagnosis results, and ML algorithms to users, who may not be familiar with ML and PdM in general. Moreover, by dynamically retrieving relevant information from technical documents and evaluating factuality of LLM generation, the accuracy and relevance of LLM generations can be improved. This work demonstrates using LLMs to explain the causes and consequences of circulating water system failures based on multiyear NPP work orders. This work tests the capability of multimodal LLM approaches in explaining the differences in the circulating water system from both the Salem and Hope Creek NPPs using both text and image resources. This work also demonstrates the use of multimodal LLMs in describing the diagnosis tab of a predictive maintenance software named VIsualization for PrEdictive maintenance Recommendation (VIPER) to users.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

High-resolution mapping of nitrogen oxide emissions in large US cities from TROPOMI retrievals of tropospheric nitrogen dioxide columns

Satellite-derived spatiotemporal patterns of nitrogen oxide (NOx) emissions can improve accuracy of emission inventories to better support air quality and climate research and policy studies. In this study, we develop a new method by coupling the chemical transport Model-Independent SATellite-derived Emission estimation Algorithm for Mixed-sources (MISATEAM) with a divergence method to map high-resolution NO x emissions across US cities using TROPOspheric Monitoring Instrument (TROPOMI) tropospheric nitrogen dioxide (NO 2 ) retrievals. The accuracy of the coupled method is validated through application to synthetic NO 2 observations from the NASA-Unified Weather Research and Forecasting (NU-WRF) model, with a horizontal spatial resolution of 4 km × 4 km for 33 large and mid-size US cities. Validation reveals excellent agreement between inferred and NU-WRF-provided emission magnitudes (R= 0.99, normalized mean bias, NMB = —0.01) and a consistent spatial pattern when comparing emissions for individual grid cells (R = 0.88 ± 0.06). We then develop a TROPOMI-based database reporting annual emissions for 39 US cities at a horizontal spatial resolution of 0.05° × 0.05° from 2018 to 2021. This database demonstrates a strong correlation (R= 0.90) with the National Emission Inventory (NEI) but reveals some bias (NMB = —0.24). There are noticeable differences in the spatial patterns of emissions in some cities. Our analysis suggests that uncertainties in TROPOMI-based emissions and potential misallocation of emissions and/or missing sources in bottom-up emission inventories both contribute to these differences.

54 ENVIRONMENTAL SCIENCES↗

A Mobile Edge Computing Framework for Traffic Optimization At Urban Intersections Through Cyber-Physical Integration

The stop-and-go traffic pattern on urban roads often results in excessive energy consumption because of unnecessary vehicle braking, idling, and accelerations. With the widespread and increased use of automobiles, this traffic pattern creates many negative impacts (e.g., delayed travel time, air pollution, and additional carbon emission) on the sustainability of our cities. Taking advantage of the recent emerging Internet of Things (IoT) and edge computing paradigms, we propose a mobile edge computing framework that integrates the capability of real-time vehicle-to-infrastructure communication and intelligent speed optimization algorithms into a mobile app to optimize individual vehicles' driving speed at signalized intersections. The optimization aims to mitigate the stop-and-go traffic pattern and its undesirable consequences in urban transportation systems. The framework consists of (1) a cyberinfrastructure-enabled dynamic messaging system for retrieving and delivering real-time traffic and signal phase and timing information from IoT-connected signal controllers and sensors, (2) a real-time speed optimization algorithm for generating intelligent speed advisory using vehicle's information (e.g., GPS and driving directions from mobile sensing) and corresponding signal and traffic information, and (3) an ad-hoc mobile computing environment that converts drivers' smartphones into edge devices to host the speed optimization algorithms for enabling intelligent advisory on the vehicle's driving speed within signalized corridors. The paper presents the design and implementation of the proposed framework. Finally, we demonstrate the feasibility, usefulness, and energy-saving benefits of our proposed framework and its prototyping mobile app on urban transportation systems through traffic simulation, real-vehicle laboratory experiments, an evaluative survey, and field communication tests. The simulation-based energy evaluation results show that the 100% usage of the mobile app can achieve 24% energy savings in the transportation system.

33 ADVANCED PROPULSION SYSTEMS↗

Micropulse Lidar Cloud Mask (MPLCMASK) Value-Added Product for the Fast-Switching Polarized Micropulse Lidar Technical Report

Lidar backscattered signal is a useful tool for identifying vertical cloud structure in the atmosphere in optically thin clouds. Cloud boundaries derived from lidar signals are a necessary input for popular ARM data products, such as the Active Remote Sensing of Clouds (ARSCL) product. An operational cloud boundary algorithm (Wang and Sassen 2001) has been implemented for use with the ARM Micropulse Lidar (MPL) systems. In addition to retrieving cloud boundaries above 500 m, the value-added product (VAP) named Micropulse Lidar Cloud Mask (MPLCMASK) applies lidar-specific corrections (i.e., range-square, background, deadtime, and overlap) as described in Campbell et al. (2002) to the measured backscattered lidar. Depolarization ratio is computed using the methodology developed by Flynn et al. (2007) for polarization-capable MPL systems. The cloud boundaries output from MPLCMASK will be the primary lidar cloud mask for input to the ARSCL product and will be applied to all MPL systems, including historical data sets.

54 ENVIRONMENTAL SCIENCES↗

Filming movies of attosecond charge migration in single molecules with high harmonic spectroscopy

Electron migration in molecules is the progenitor of chemical reactions and biological functions after light-matter interaction. Following this ultrafast dynamics, however, has been an enduring endeavor. Here we demonstrate that, by using machine learning algorithm to analyze high-order harmonics generated by two-color laser pulses, we are able to retrieve the complex amplitudes and phases of harmonics of single fixed-in-space molecules. These complex dipoles enable us to construct movies of laser-driven electron migration after tunnel ionization of N 2 and CO 2 molecules at time steps of 50 attoseconds. Moreover, the angular dependence of the migration dynamics is fully resolved. By examining the movies, we observe that electron holes do not just migrate along the laser polarization direction, but may swirl around the atom centers. Our result establishes a general scheme for studying ultrafast electron dynamics in molecules, paving a way for further advance in tracing and controlling photochemical reactions by femtosecond lasers.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Integrated Large-Scale Data Management Platform for Photovoltaic Power Conversion Equipment (PCE) Reliability Data

To meet the demand for accuracy and real-time capability of PV system degradation evaluation, massive volume data is needed to run high-fidelity and high-efficiency simulations and perform advanced data analysis. However, PV farm operators have a series of difficulties with PV inverter data, such as data collection from multiple channels, massive data storage, data management and massive data analysis. To address these challenges, we developed an integrated data management platform capable of data acquisition, processing, storage, query, and performing big data analysis utilizing AI algorithms. The platform can also achieve data correctness verification and provide an effective distributed data management solution to retrieve massive data and establish a connection to distributed computational frameworks.

data management platform↗

Integrated Large-Scale Data Management Platform for Photovoltaic Power Conversion Equipment (PCE) Reliability Data: Preprint

To meet the demand for accuracy and real-time capability of PV system degradation evaluation, massive volume data is needed to run high-fidelity and high-efficiency simulations and perform advanced data analysis. However, PV farm operators have a series of difficulties with PV inverter data, such as data collection from multiple channels, massive data storage, data management and massive data analysis. To address these challenges, we developed an integrated data management platform capable of data acquisition, processing, storage, query, and performing big data analysis utilizing AI algorithms. The platform can also achieve data correctness verification and provide an effective distributed data management solution to retrieve massive data and establish a connection to distributed computational frameworks.

data management↗

Sign-OPT: A Query-Efficient Hard-label Adversarial Attack

We study the most practical problem setup for evaluating adversarial robustness of a machine learning system with limited access: the hard-label black-box attack setting for generating adversarial examples, where limited model queries are allowed and only the decision is provided to a queried data input. Several algorithms have been proposed for this problem but they typically require huge amount (>20,000) of queries for attacking one example. Among them, one of the state-of-the-art approaches (Cheng et al., 2019) showed that hard-label attack can be modeled as an optimization problem where the objective function can be evaluated by binary search with additional model queries, thereby a zeroth order optimization algorithm can be applied. In this paper, we adopt the same optimization formulation but propose to directly estimate the sign of gradient at any direction instead of the gradient itself, which enjoys the benefit of single query. Using this single query oracle for retrieving sign of directional derivative, we develop a novel query-efficient Sign-OPT approach for hard-label black-box attack. We provide a convergence analysis of the new algorithm and conduct experiments on several models on MNIST, CIFAR-10 and ImageNet. We find that Sign-OPT attack consistently requires 5X to 10X fewer queries when compared to the current state-of-the-art approaches, and usually converges to an adversarial example with smaller perturbation.

Cheng, Minhao↗

A review of ptychographic techniques for ultrashort pulse measurement

The measurement of optical ultrafast laser pulses is done indirectly because the required bandwidth to measure these pulses exceeds the bandwidth of current electronics. As a result, this measurement problem is often posed as a 1-D phase retrieval problem, which is fraught with ambiguities. The phase retrieval method known as ptychography solves this problem by making it possible to measure ultrafast pulses in either the time domain or the frequency domain. One well known algorithm is the principal components generalized projections algorithm (PCGPA) for extracting pulses from Frequency-Resolved Optical Gating (FROG) measurements. In this work, we discuss the development of the PCPGA and introduce new developments including an operator formalism that allows for the convenient addition of external constraints and the development of more robust algorithms. A close cousin, the ptychographic iterative engine will also be covered and compared to the PCGPA. Additional developments using other algorithmic strategies will also be discussed along with new developments combining optics and high-speed electronics to achieve megahertz measurement rates.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Towards real-time monitoring: data assimilated time-lapse full waveform inversion for seismic velocity and uncertainty estimation

SUMMARY Rapid development of time-lapse seismic monitoring instrumentations has made it possible to collect dense time-lapse data for tomographically retrieving time-lapse (even continuous) images of subsurface changes. While traditional time-lapse full waveform inversion (TLFWI) algorithms are designed for sparse time-lapse surveys, they lack of effective temporal constraint on time-lapse data, and, more importantly, lack of the uncertainty estimation of the TLFWI results that is critical for further interpretation. Here, we propose a new data assimilation TLFWI method, using hierarchical matrix powered extended Kalman filter (HiEKF) to quantify the image uncertainty. Compared to existing Kalman filter algorithms, HiEKF allows to store and update a data-sparse representation of the cross-covariance matrices and propagate model errors without expensive operations involving covariance matrices. Hence, HiEKF is computationally efficient and applicable to 3-D TLFWI problems. Then, we reformulate TLFWI in the framework of HiEKF (termed hereafter as TLFWI-HiEKF) to predict time-lapse images of subsurface spatiotemporal velocity changes and simultaneously quantify the uncertainty of the inverted velocity changes over time. We demonstrate the validity and applicability of TLFWI–HiEKF with two realistic CO2 monitoring models derived from Frio-II and Cranfield CO2 injection sites, respectively. In both 2-D and 3-D examples, the inverted high-resolution time-lapse velocity results clearly reveal a continuous velocity reduction due to the injection of CO2. Moreover, the accuracy of the model is increasing over time by assimilating more time-lapse data while the standard deviation is decreasing over lapsed time. We expect TLFWI-HiEKF to be equipped with real-time seismic monitoring systems for continuously imaging the distribution of subsurface gas and fluids in the future large-scale CO2 sequestration experiments and reservoir management.

58 GEOSCIENCES↗

A General Framework for Progressive Data Compression and Retrieval

In scientific simulations, observations, and experiments, the transfer of data to and from disk and across networks has become a major bottleneck for data analysis and visualization. Compression techniques have been employed to tackle this challenge, but traditional lossy methods often demand conservative error tolerances to meet the numerical accuracy requirements of both anticipated and unknown data analysis tasks. Progressive data compression and retrieval has emerged as a promising solution, where each analysis task dictates its own accuracy needs. However, few analysis algorithms inherently support progressive data processing, and adapting compression techniques, file formats, client/server frameworks, and APIs to support progressivity can be challenging. Here, this paper presents a framework that enables progressive-precision data queries for any data compressor or numerical representation. Our strategy hinges on a multi-component representation that successively reduces the error between the original and compressed field, allowing each field in the progressive sequence to be expressed as a partial sum of components. We have implemented this approach with four established scientific data compressors and assessed its effectiveness using real-world data sets from the SDRBench collection. The results show that our framework competes in accuracy with the standalone compressors it is based upon. Additionally, (de)compression time is proportional to the number of components requested by the user. Finally, our framework allows for fully lossless compression using lossy compressors when a sufficient number of components are employed.

97 MATHEMATICS AND COMPUTING↗

Data product development for cold cloud and precipitation process analysis/Snow regime classifications from the NSA snow product

This grant funded work focused first on developing a data product for cold-cloud precipitation and second, under a continuation, on examining distinct snowfall regimes occurring at the North Slope Alaska (NSA) facility. The overarching goal under the first phase was to provide a data product that quantifies the vertically- and temporally-resolved properties of cold, precipitating clouds and that will enable future analyses of the processes that control their formation and evolution. The data product derives from observations at the NSA Utqiagvik (BRW) and Oliktok Point (OLI) sites, its algorithm utilizing radar observations supplemented with in situ and other collocated remote sensing measurements to constrain an optimal estimation retrieval.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Graph Analytics Frameworks Using the GAP Benchmark Suite

The analysis of connected data is an increasingly important application in high-performance computing. Such analyses can reveal fraudulent patterns in financial transactions, optimize telecommunications networks, predict information flow in social networks, etc. However, the landscape of graph analytics is highly diverse. Graph algorithms stress processor architectures differently, and no one graph can represent all topologies. Consequently, no single approach or framework is expected to be optimal for all graph analytics problems. To help make sense of this diverse landscape, we evaluated four approaches to graph analytics: GraphBLAS, Galois, BGL17, GraphIt; and compare them against hand-tuned implementations that take advantage of hardware features on our test platform. Graph- BLAS formulates graph analytics as sparse linear algebra. Galois provides syntactic constructs for data parallelism over irregular data structures. BGL17 is a generic C++ template library for implementing graph algorithms. GraphIt provides a domain- specific language to describe and optimize graph algorithms. We use the GAP Benchmark Suite to establish baseline performance and guide the side-by-side evaluation of each framework. GAP consists of 30 tests: six graph analytics algorithms (breadth- first search, single-source shortest path, PageRank, betweenness centrality, connected components, and triangle counting) run on five graphs, each with different topological characteristics (e.g., high diameter, skewed degree distribution, high average degree). High-performance reference implementations are included for each benchmark algorithm. Because a graph can be loaded into memory a number of ways (e.g., flat file on disk, compressed sparse format, data frames, retrieved from SQL or NoSQL databases), our evaluation focused on computational performance rather than I/O. Our results show the relative strengths of each framework.

Graph algorithms, Benchmarking, shared-memory prog↗

Marine Boundary Layer Cloud Boundaries and Phase Estimation Using Airborne Radar and In Situ Measurements During the SOCRATES Campaign over Southern Ocean

The Southern Ocean Clouds, Radiation, Aerosol Transport Experimental Study (SOCRATES) was an aircraft-based campaign (15 January–26 February 2018) that deployed in situ probes and remote sensors to investigate low-level clouds over the Southern Ocean (SO). A novel methodology was developed to identify cloud boundaries and classify cloud phases in single-layer, low-level marine boundary layer (MBL) clouds below 3 km using the HIAPER Cloud Radar (HCR) and in situ measurements. The cloud base and top heights derived from HCR reflectivity, Doppler velocity, and spectrum width measurements agreed well with corresponding lidar-based and in situ estimates of cloud boundaries, with mean differences below 100 m. A liquid water content–reflectivity (LWC-Z) relationship, LWC = 0.70Z0.29, was derived to retrieve the LWC and liquid water path (LWP) from HCR profiles. The cloud phase was classified using HCR measurements, temperature, and LWP, yielding 40.6% liquid, 18.3% mixed-phase, and 5.1% ice samples, along with drizzle (29.1%), rain (3.2%), and snow (3.7%) for drizzling cloud cases. The classification algorithm demonstrates good consistency with established methods. This study provides a framework for the boundary and phase detection of MBL clouds, offering insights into SO cloud microphysics and supporting future efforts in satellite retrievals and climate model evaluation.

MBL clouds over Southern Ocean↗

Four Years of Atmospheric Boundary Layer Height Retrievals Using COSMIC-2 Satellite Data

This work aimed to study the atmospheric boundary layer height (ABLH) from COSMIC-2 refractivity data, endeavoring to refine existing ABLH detection algorithms and scrutinize the resulting spatial and seasonal distributions. Through validation analyses involving different ground-based methodologies (involving data from lidar, ceilometer, microwave radiometers, and radiosondes), the optimal ABLH determination relied on identifying the lowest refractivity gradient negative peak with a magnitude at least $τ$% times the minimum refractivity gradient magnitude, where $τ$ is a fitting parameter representing the minimum peak strength relative to the absolute minimum refractivity gradient. Different $τ$ values were derived accounting for the moment of the day (daytime, nighttime, or sunrise/sunset) and the underlying surface (land or sea). Results show discernible relations between ABLH and various features, notably, the land cover and latitude. On average, ABLH is higher over oceans (≈1.5 km), but extreme values (maximums > 2.5 km, and minimums < 1 km) are reached over intertropical lands. Variability is generally subtle over oceans, whereas seasonality and daily evolution are pronounced over continents, with higher ABLHs during daytime and local wintertime (summertime) in intertropical (middle) latitudes.

54 ENVIRONMENTAL SCIENCES↗

Tansey_MICRE_D98_microphysics_V5

This data file contains retrievals of cloud-effective-radius and cloud-droplet-number-concentration for low clouds based on the Dong et al. 1998 retrieval technique for the MICRE campaign. The retrieval is based on observed downwelling broadband SW fluxes and microwave-radiometer-retrieved-liquid-water-path averaged on a 5 minute time scale (mean when low cloud is present). Details on the algorithm and analysis of results are given in Tansey et al. 2024 (submitted DOI: 10.22541/essoar.173482310.03809503/v1). The data is limited to the period 20160410 to 20160612 AND 20170103 to 20170214 during which time good quality microwave-radiometer measurements are available.

54 ENVIRONMENTAL SCIENCES↗