Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Surface elevation, snow depth, vegetation height, and color imagery from multiple UAV surveys from 2018 to 2023 across a watershed near Teller road mile marker 27, Seward Peninsula, Alaska

Multiple photogrammetric surveys using an unoccupied aerial system (UAS) were performed across a watershed along Teller road on the Seward Peninsula (Alaska) to investigate terrain, vegetation and snowpack properties. This work was led by the environmental geophysics team from Lawrence Berkeley National Laboratory as part of the Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic). The multiple photogrammetric surveys used mostly a DJI Matrice 210 UAS with a DJI X5S camera, Ground Control Points (GCPs) surveyed with a Real Time Kinematic (RTK)-GPS, and a structure from motion (SfM) technique for photogrammetric reconstruction. Digital Surface elevation Models (DSMs) were inferred at various times of year, including near peak in plant and leaf density (July 19 2017), close to peak in snow depth (April 1 2019 and April 11 2022), and at low plant and leaf density of tall after the first bare-ground date (June 9 2019). Snow and canopy height were obtained by subtracting DSMs from a Digital Terrain Model (DTM) proxy inferred from the June 9 2019 survey. The derived products include ortho-mosaiced RGB map, DSMs, a DTM proxy, snow depth (April 2019 and 2022) and canopy height (July 2017). Unprocessed and processed data products are included in this package (processing levels 0-2). Data and metadata are provided as text (*.csv), image (*.jpg), and GeoTiff (*.tif) formats. This metadata document contains a description of the survey and processing steps and the inferred products.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Applying mobile technology to data collection for environmental characterization and remediation, beyond the science - 15453

The rapid advancements of our time bring us new methods of analysis that enhance the accuracy and sensitivity of measurement, improving the science used to solve problems and meet our objectives. What is often overlooked in our industry are the technology advancements that can dramatically improve the speed, accuracy and completeness by which those data can be collected, communicated, managed and reported. In addition, in the time used to generate and collect the analytical data, the technology collects, manages and reports other process data that can be used to better manage and facilitate our business process improving efficiency and communications as well as providing the information needed to track and manage cost and schedule. Good information management practices, including the use of innovative technology solutions like mobile data collection, are the drivers for project implementation. However, experience has highlighted key success factors that will maximize the level of success and benefit realized by the project. These factors include: -A comprehensive, working knowledge of operational objectives; - Detailed, documented process and data work-flows; - Effective technology selection and/or development (right tool for the job); - Complete integration of the technology into day to day work practice accomplished through effective training and implementation planning. Once this formula is in place, and executed consistently, it can be applied to any environmental investigation and/or remediation scenario. The proof is in the calculated return on investment and captured lessons learned for each project. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Tanana River Test Site Model Verification Using the Marine and Hydrokinetic Toolkit (MHKiT)

The marine energy (ME) industry historically lacked a standardized data processing toolkit for common tasks such as data ingestion, quality control, and visualization. The marine and hydrokinetic toolkit (MHKiT) solved this issue by providing a public software deployment (open-source and free) toolkit for the ME industry to store and maintain commonly used functionality for wave, tidal, and river energy. This paper demonstrates an initial model verification study in MHKiT. Using Delft3D, a numerical model of the Tanana River Test Site (TRTS) at Nenana, Alaska was created. Field data from the site was collected using an Acoustic Doppler Current Profiler (ADCP) at the proposed Current Energy Converter (CEC) locations. MHKiT is used to process model simulations from Delft3D and compare them to the transect data from the ADCP measurements at TRTS. The ability to use a single tool to process simulation and field data demonstrates the ease at which the ME industry can obtain results and collaborate across specialties, reducing errors and increasing efficiency.

13 HYDRO ENERGY↗

Post-fire time series of sensor and geochemistry sample data from surface water, groundwater, precipitation, soil, and vegetation across Oak Creek watershed, Washington

This dataset supports a broader study examining wildfire impacts on hydrologic connectivity across 5 sites within the Oak Creek watershed and the resulting biogeochemical impacts. Stream sites were selected using the Advanced Terrestrial Simulator (ATS) hydrologic model to identify locations with varying groundwater contributions and hydrologic responses across different burn severity scenarios. The Retreat Fire burned from July 23 to August 2 in 2024, affecting the five study sites at varying burn severities. Each site is equipped with YSI EXO2 sondes logging sub-hourly throughout the year, and grab samples are collected approximately every six weeks. YSI sondes are used to measure temporally resolved proxies for groundwater inputs (specific conductivity) and organic matter (fluorescent dissolved organic matter; fDOM) along with basic water quality and depth. Grab samples of surface water, groundwater, and precipitation are analyzed for water stable isotopes and conductivity to understand endmembers for hydrologic mixing Grab samples of surface water, groundwater, soil water, and litter/vegetation/soil leachates are analyzed for organic matter composition measured by Fourier-Transform Ion Cyclotron Resonance Mass Spectrometry (FTICR-MS) to understand organic matter dynamics. Game camera photos are provided in a separate data package available at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/3018598. Future versions of this dataset will include time series data from YSI EXO2 sondes (fDOM, dissolved oxygen, temperature, depth, specific conductance, turbidity, pH), BaroTROLL sensors (air temperature and barometric pressure), rain gauges (precipitation), and data from the soil and vegetation samples. Because this study is ongoing, this data package will be updated regularly to include newly collected data and the additional data types. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) a folder of field photos; (2) a folder of surface water sample data; (3) a folder of raw Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) data; (4) a data checks report; (5) file-level metadata; (6) data dictionary; (7) field metadata; (8) readme; (9) international generic sample number (IGSN) mapping file; and (10) field protocols. The sample data subfolder contains (1) dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) data and averages; (2) total dissolved nitrogen data and averages; (3) stable water isotopes and averages; (4) methods codes; (5) FTICR-MS methods; and (15) a subfolder of 9.4 Tesla (9.4T) FTICR-MS data. This folder contains the processed data and three subfolders, one containing the .xml files, one containing the water CoreMS output files, and the other containing instructions and scripts for processing the files in CoreMS (https://github.com/EMSL-Computing/CoreMS). All files are .csv, .pdf, .R, .xml, .d, .html, .Rmd, .py, .cal, .json, .jpg, .jpeg, .png, .mov, or .mp4.

Biogeochemistry↗

WHONDRS Surface Water Geochemistry and Organic Matter Characterization Data from Streams Distributed across Latin America

This dataset supports a broader study examining global transferability of stream biogeochemistry and was generated in collaboration with the MicroSudAqua (µSudAqua) network (https://microsudaqua.netlify.app/en/). The dataset provides surface water geochemistry (dissolved organic carbon, total dissolved nitrogen, cations) and organic matter characterization (FTICR-MS) from streams in Argentina, Brazil, Chile, and Colombia. Samples were collected across stream orders (1st to 6th order) within five basins. Related data were collected and will be published separately in collaboration with the µSudAqua network. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to this readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) a folder of field photos; (2) a folder of surface water sample data, (3) a folder of raw Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) data; (4) file-level metadata; (5) data dictionary; (6) field metadata; (7) readme; (8) international generic sample number (IGSN) mapping file; and (9) field protocol. The sample data subfolder contains (1) dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) data and averages; (2) total dissolved nitrogen data and averages; (3) anions and averages; (4) methods codes; (5) FTICR-MS methods; and (15) a subfolder of 9.4 Tesla (9.4T) FTICR-MS data. This folder contains the processed data and three subfolders, one containing the .xml files, one containing the water CoreMS output files, and the other containing instructions and scripts for processing the files in CoreMS (https://github.com/EMSL-Computing/CoreMS). All files are .csv, .pdf, .R, .xml, .d, .html, .Rmd, .py, .cal, .json, .jpg, .jpeg, .png, .mov, or .mp4.

Anions↗

Delta: Data Reduction for Integrated Application Workflows

Integrated Application Workflows (IAWs) run multiple simulation workflow components concurrently on an HPC resource connecting these components using compute area resources and compensating for any performance or data processing rate mismatches. These IAWs require high frequency and high volume data transfers between compute nodes and staging area nodes during the lifetime of a large parallel computation. The available network band-width between the two areas may not be enough to efficiently support the data movement. As the processing power available to compute resources increases, the requirements for this data transfer will become more difficult to satisfy and perhaps will not be satisfiable at all since network capabilities are not expanding at a comparable rate. Furthermore, energy consumption in HPC environments is expected to grow by an order of magnitude as exascale systems become a reality. The energy cost of moving large amounts of data frequently will contribute to this issue. It is necessary to reduce the volume of data without reducing the quality of data when it is being processed and analyzed. Delta resolves the issue by addressing the lifetime data transfer operations. Delta removes subsequent identical copies of already transmitted data during transfers and restores those copies once the data has reached the destination. Delta is able to identify duplicated information and determine the most space efficient way to represent it. Initial tests show about 50% reduction in data movement while maintaining the same data quality and transmission frequency.

97 MATHEMATICS AND COMPUTING↗

Realization Of Algebraic Processor For XML Documents Processing

In this paper, are presented some possibilities concerning the implementation of an algebraic method for XML hierarchical data processing which makes faster the XML search mechanism. Here is offered a different point of view for creation of advanced algebraic processor (with all necessary software tools and programming modules respectively). Therefore, this nontraditional approach for fast XML navigation with the presented algebraic processor may help to build an easier user-friendly interface provided XML transformations, which can avoid the difficulties in the complicated language constructions of XSL, XSLT and XPath. This approach allows comparatively simple search of XML hierarchical data by means of the following types of functions: specification functions and so named build-in functions. The choice of programming language Java may appear strange at first, but it isn't when you consider that the applications can run on different kinds of computers. The specific search mechanism based on the linear algebra theory is faster in comparison with MSXML parsers (on the basis of the developed examples with about 30%). Actually, there exists the possibility for creating new software tools based on the linear algebra theory, which cover the whole navigation and search techniques characterizing XSLT/XPath. The proposed method is able to replace more complicated operations in other SOA components.

99 GENERAL AND MISCELLANEOUS↗

Using Process Load Cell Information for IAEA Safeguards at Enrichment Plants

Uranium enrichment service providers are expanding existing enrichment plants and constructing new facilities to meet demands resulting from the shutdown of gaseous diffusion plants, the completion of the U.S.-Russia highly enriched uranium downblending program, and the projected global renaissance in nuclear power. The International Atomic Energy Agency (IAEA) conducts verification inspections at safeguarded facilities to provide assurance that signatory States comply with their treaty obligations to use nuclear materials only for peaceful purposes. Continuous, unattended monitoring of load cells in UF{sub 6} feed/withdrawal stations can provide safeguards-relevant process information to make existing safeguards approaches more efficient and effective and enable novel safeguards concepts such as information-driven inspections. The IAEA has indicated that process load cell monitoring will play a central role in future safeguards approaches for large-scale gas centrifuge enrichment plants. This presentation will discuss previous work and future plans related to continuous load cell monitoring, including: (1) algorithms for automated analysis of load cell data, including filtering methods to determine significant weights and eliminate irrelevant impulses; (2) development of metrics for declaration verification and off-normal operation detection ('cylinder counting,' near-real-time mass balancing, F/P/T ratios, etc.); (3) requirements to specify what potentially sensitive data is safeguards relevant, at what point the IAEA gains on-site custody of the data, and what portion of that data can be transmitted off-site; (4) authentication, secure on-site storage, and secure transmission of load cell data; (5) data processing and remote monitoring schemes to control access to sensitive and proprietary information; (6) integration of process load cell data in a layered safeguards approach with cross-check verification; (7) process mock-ups constructed to provide simulated load cell data; (8) hardware and software implementation for process load cell data collection; (9) costs associated with unattended monitoring of load cells (for both operator and inspector) weighed against the potential benefits of having access to such data; (10) results from field tests of load cell data collection systems in operating facilities; and (11) use of unattended load cell data to increase efficiency of on-site inspection schedules and activities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Multi phenomena melt pool sensor data fusion for enhanced process monitoring of laser powder bed fusion additive manufacturing

Finding actionable trends in laser-based metal additive manufacturing process monitoring data is challenging owing to the diversity and complexity of the underlying physical interactions. A single monitoring solution that captures a particular process phenomenon, such as a photodiode that tracks melt pool intensity, is not alone capable of evaluating process stability or detecting flaw formation with sufficient precision for routine application in industry. In this work, to improve flaw detection performance, we adopted a data fusion approach that captures multiple process phenomena. To demonstrate this, we acquired data from laser powder bed fusion (LPBF) builds of cylindrical specimens produced with different laser spot sizes, emulating defocusing due to process faults such as thermal lensing. The resulting specimens had porosity of varying types and severity, quantified by post-build non-destructive X-ray computed tomography, Archimedes density measurements, and destructive metallographic characterization. During the build, the melt pool state was monitored with two coaxial high-speed video cameras and a temperature field imaging system. Physically intuitive low-level melt pool signatures, such as melt pool temperature, shape and size, and spatter intensity were extracted from this high-dimensional, image-based sensor data. These process signatures were subsequently used as input features in relatively simple machine learning models, such as a support vector machine, which were trained to detect laser defocusing, and in addition, predict porosity type and severity. The results show that the data fusion approach significantly enhanced system performance by reducing the overall false positive rate from ~ 0.1 to ~ 0.001 without sacrificing the true positive rate (~0.90). These results were at par with a black-box, deep machine learning approach (convolutional neural network).

36 MATERIALS SCIENCE↗

Methods of resolving artifacts in Hadamard-transformed data

Apparatus and methods are disclosed for processing data transformed according to an invertible transform (e.g., using a Hadamard transform) multiplexing scheme. In one example of the disclosed technology, a computer-implemented method includes generating transformed data by applying a Hadamard transform to intensity data generated by modulating input of analytes into a mass spectrometer according to a pseudorandom sequence (PRS). The exemplary method further includes identifying at least one pair of symmetric intensity peaks in the transformed data based on the PRS and removing data associated with the pair of symmetric peaks from the transformed data to produce modified data, which can be used to identify, characterize, and/or quantify the composition of the sample. In some examples, the exemplary method further includes validating peaks in the transformed data based on comparing the location of peaks in the untransformed intensity data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Frost Table Elevation across a Low-Centered and a High-Centered Polygon, Mapped using Ground Penetrating Radar, Utqiagvik (Barrow), Alaska, 2015

Ground Penetrating Radar, active layer thickness point measurements, and ground elevation surveys were conducted on a low-centered and a high-centered polygon in Utqiagvik (Barrow), AK (on October 2nd, 2015) to map frost table topography and evaluate its influence on hydrological flow. Data were collected to improve our understanding of the topography of the permafrost table across polygons which may have a major influence on hydrology. This dataset includes 2 zip files containing the raw data, 2 csv files of processed data, and a pdf user guide.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Secure Data Logging and Processing with Blockchain and Machine Learning (Final Report)

Secure Data Logging and Processing with Blockchain and Machine Learning (ML) research is focused on the development of a platform to securely log and process sensor data in fossil power plants. The platform integrates two emerging technologies, blockchain and ML, and incorporates several innovative mechanisms to ensure the integrity, reliability, and resiliency of power systems. The goal is to protect the power plant from various cyberattacks such as false data injection and denial of service attacks using these technologies. The research goal was enabled by the following Research Project Objectives: 1) Secure authentication and identity verification of sensor nodes, actuators, and other equipment within a network. 2) Development of mechanisms that ensure only data sent by legitimate sensors are accepted and stored in the data repository. 3) Development of data aggregation methodologies using ML / Deep Learning (DL) algorithms to minimize noise / faulty data. 4) Implementation of the blockchain technologies to provide data security using secured IOTA framework & nodes.

20 FOSSIL-FUELED POWER PLANTS↗

Estimating active layer thickness and volumetric water content from ground penetrating radar measurements in Barrow, Alaska

Ground penetrating radar (GPR) has emerged as an effective tool for estimating active layer thickness (ALT) and volumetric water content (VWC) within the active layer. In August 2013, we conducted a series of GPR and probing surveys using a 500 MHz antenna and metallic probe around Barrow, Alaska. Here, we collected about 15 km of GPR data and 1.5 km of probing data. We describe the GPR data processing workflow from raw GPR data to the estimated ALT and VWC. We then include the corresponding uncertainties for each measured and estimated parameter. The estimated average GPR-derived ALT was 41 cm, with a standard deviation of 9 cm. The average probed ALT was 40 cm, with a standard deviation of 12 cm. The average GPR-derived VWC was 0.65, with a standard deviation of 0.14.

58 GEOSCIENCES↗

The creation of a comprehensive metocean data set for offshore wind turbine simulations: Comprehensive metocean data set

A database of meteorological and ocean conditions is presented for use in offshore wind energy research and design. The original data are from 23 ocean sites around the USA and were obtained from the National Data Buoy Center run by the National Oceanic and Atmospheric Administration. The data are presented in a processed form that includes the variables of interest for offshore wind energy design: wind speed, significant wave height, wave peak-spectral period, wind direction and wave direction. For each site, a binning process is conducted to create conditional probability functions for each of these variables. The sites are then grouped according to geographic location and combined to create three representative sites, including a West Coast site, an East Coast site and a Gulf of Mexico site. Both the processed data and the probability distribution parameters for the individual and representative sites are being hosted on a publicly available domain by the National Renewable Energy Laboratory, with the intent of providing a standard basis of comparison for meteorological and ocean conditions for offshore wind energy research worldwide.

17 WIND ENERGY↗

(Phospho)Proteomic dataset of ischemia- and ultrasound- stimulated mouse cardiac endothelial cells in vitro

Cardiac endothelial cells respond to both ischemia and therapeutic ultrasound; the proteomic changes underlying these responses are unknown. This data article provides raw and processed data resulting from our global, unbiased phosphoproteomics investigation conducted on primary mouse cardiac endothelial cells exposed to ischemia (2-hour oxygen glucose deprivation) and ultrasound (250 kHz, 1.2 MPa) in vitro [1]. Proteins were extracted from cell lysates and enriched phosphopeptides were analyzed with a high mass accuracy liquid chromatrography (LC) - tandem mass spectrometry (MS/MS) proteomic platform, yielding multiple alterations in both total protein levels and phosphorylation events in response to ischemic injury and ultrasound. This dataset can be used as a reference for future studies on the cardiac endothelial response to ischemia and the mechanistic underpinnings of the cellular response to ultrasound, with the potential to yield clinically relevant therapeutic targets.

59 BASIC BIOLOGICAL SCIENCES↗

The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond

While the computing landscape supporting LHC experiments is currently dominated by x86 processors at WLCG sites, this configuration will evolve in the coming years. LHC collaborations will be increasingly employing HPC and Cloud facilities to process the vast amounts of data expected during the LHC Run 3 and the future HL-LHC phase. These facilities often feature diverse compute resources, including alternative CPU architectures like ARM and IBM Power, as well as a variety of GPU specifications. Using these heterogeneous resources efficiently is thus essential for the LHC collaborations reaching their future scientific goals. The Submission Infrastructure (SI) is a central element in CMS Computing, enabling resource acquisition and exploitation by CMS data processing, simulation and analysis tasks. The SI must therefore be adapted to ensure access and optimal utilization of this heterogeneous compute capacity. Some steps in this evolution have been already taken, as CMS is currently using opportunistically a small pool of GPU slots provided mainly at the CMS WLCG sites. Additionally, Power9 processors have been validated for CMS production at the Marconi-100 cluster at CINECA. This note will describe the updated capabilities of the SI to continue ensuring the efficient allocation and use of computing resources by CMS, despite their increasing diversity. The next steps towards a full integration and support of heterogeneous resources according to CMS needs will also be reported.

Pérez-Calero Yzquierdo, Antonio↗