Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

ZMPY3D: accelerating protein structure volume analysis through vectorized 3D Zernike moments and Python-based GPU integration

Abstract Motivation Volumetric 3D object analyses are being applied in research fields such as structural bioinformatics, biophysics, and structural biology, with potential integration of artificial intelligence/machine learning (AI/ML) techniques. One such method, 3D Zernike moments, has proven valuable in analyzing protein structures (e.g., protein fold classification, protein–protein interaction analysis, and molecular dynamics simulations). Their compactness and efficiency make them amenable to large-scale analyses. Established methods for deriving 3D Zernike moments, however, can be inefficient, particularly when higher order terms are required, hindering broader applications. As the volume of experimental and computationally-predicted protein structure information continues to increase, structural biology has become a “big data” science requiring more efficient analysis tools. Results This application note presents a Python-based software package, ZMPY3D, to accelerate computation of 3D Zernike moments by vectorizing the mathematical formulae and using graphical processing units (GPUs). The package offers popular GPU-supported libraries such as CuPy and TensorFlow together with NumPy implementations, aiming to improve computational efficiency, adaptability, and flexibility in future algorithm development. The ZMPY3D package can be installed via PyPI, and the source code is available from GitHub. Volumetric-based protein 3D structural similarity scores and transform matrix of superposition functionalities have both been implemented, creating a powerful computational tool that will allow the research community to amalgamate 3D Zernike moments with existing AI/ML tools, to advance research and education in protein structure bioinformatics. Availability and implementation ZMPY3D, implemented in Python, is available on GitHub (https://github.com/tawssie/ZMPY3D) and PyPI, released under the GPL License.

Lai, Jhih-Siang (ORCID:0000000156775890)↗
DOE OSTI2018

SciDAC – PSI: Plasma Surface Interactions involving Tungsten - A Summary of Project Accomplishments

Gaining physics understanding and predictive capabilities to describe the evolution of plasma facing components (PFC) requires simultaneously addressing complex and diverse physics occurring over a wide range of length and time scales, as well as integrating extensive physical processes across the plasma - surface - bulk materials boundaries. This requires development not only of detailed physics models and computational strategies at each of these scales, but computer science algorithms and methods to strongly couple them in a way that can be robustly validated through comparisons against available data and new experiments. Therefore, the objective of this project is to develop robust, high-fidelity simulation tools capable of predicting the PFC operating lifetime and the PFC impact on plasma contamination, recycling of hydrogenic species, and tritium retention in future magnetic fusion devices, with a focus on tungsten based material systems. Deploying these tools requires the development of a leadershipscale computational code, as well as a host of simulations that span the multiple scales needed to address complex physical and computational issues at the plasma - surface interface and the transition below the surface where neutron damage processes in the bulk material dominate behavior in multiple-component materials systems. Successful development will enable improved prediction of PFC performance needed to ensure magnetic fusion energy development beyond ITER.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2014

Resolving small signal measurements in experimental plasma environments using calibrated subtraction of noise signals

The performance of many diagnostic and control systems within fusion and other fields of research are often detrimentally affected by spurious noise signals. This is particularly true for those (such as radiation or particle detectors) working with very small signals. Common sources of radiated and conducted noise in experimental fusion environments include the plasma itself and instrumentation. The noise complicates data analysis, as illustrated by noise on signals measured with the heavy ion beam probe (HIBP) installed on the Madison Symmetric Torus. The noise is time-varying and often exceeds the secondary ion beam current (in contrast with previous applications). Analysis of the noise identifies the dominant source as photoelectric emission from the detectors induced by ultraviolet light from the plasma. This has led to the development of a calibrated subtraction technique, which largely removes the undesired temporal noise signals from data. The advantages of the technique for small signal measurement applications are demonstrated through improvements realized on HIBP fluctuation measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2018

In Situ Indexing and Query Processing of AMR Data

We have developed the first, holistic, Adaptive Mesh Refinement (AMR) capable, in situ query framework to ensure the tractability of the current- and next-generation AMR simulation analysis on the path to extreme scale. We have addressed key issues pertaining to in situ analysis, memory hierarchy, generalized parallel indexing, index-compression, and real-time access pattern detection. We have published the following research papers in high profile peer reviewed computer science conferences: (a) Parallel In Situ Detection of Connected Components in Adaptive Mesh Refinement Data; (b) AMR-aware In Situ Indexing and Scalable Querying; (c) Pattern-driven dynamic data layout optimization; (d) In situ Storage Layout Optimization for AMR Spatio-temporal Read Accesses; (e) AMRZone: A Runtime AMR Data Sharing Framework for Scientific Applications; (f) Exploring Memory Hierarchy and Network Topology for Runtime AMR Data Sharing Across Scientific Applications.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2017

Advances in Cross-Cutting Ideas for Computational Climate Science

This report presents results from the DOE-sponsored workshop titled, ``Advancing X-Cutting Ideas for Computational Climate Science Workshop,'' known as AXICCS, held on September 12--13, 2016 in Rockville, MD. The workshop brought together experts in climate science, computational climate science, computer science, and mathematics to discuss interesting but unsolved science questions regarding climate modeling and simulation, promoted collaboration among the diverse scientists in attendance, and brainstormed about possible tools and capabilities that could be developed to help address them. Emerged from discussions at the workshop were several research opportunities that the group felt could advance climate science significantly. These include (1) process-resolving models to provide insight into important processes and features of interest and inform the development of advanced physical parameterizations, (2) a community effort to develop and provide integrated model credibility, (3) including, organizing, and managing increasingly connected model components that increase model fidelity yet complexity, and (4) treating Earth system models as one interconnected organism without numerical or data based boundaries that limit interactions. The group also identified several cross-cutting advances in mathematics, computer science, and computational science that would be needed to enable one or more of these big ideas. It is critical to address the need for organized, verified, and optimized software, which enables the models to grow and continue to provide solutions in which the community can have confidence. Effectively utilizing the newest computer hardware enables simulation efficiency and the ability to handle output from increasingly complex and detailed models. This will be accomplished through hierarchical multiscale algorithms in tandem with new strategies for data handling, analysis, and storage. These big ideas and cross-cutting technologies for enabling breakthrough climate simulation advancements also need the "glue" of outreach and learning across the scientific domains to be successful. The workshop identified several strategies to allow productive, continuous engagement across those who have a broad knowledge of the various angles of the problem. Specific ideas to foster education and tools to make material progress were discussed. Examples include follow-on cross-cutting meetings that enable unstructured discussions of the types this workshop fostered. A concerted effort to recruit undergraduate and graduate students from all relevant domains and provide them experience, training, and networking across their immediate expertise is needed. This will broaden and expand their exposure to the future needs and solutions, and provide a pipeline of scientists with a diversity of knowledge and know-how. Providing real-world experience with subject matter experts from multiple angles may also motivate the students to attack these problems and even come up with the missing solutions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Advances in Cross-Cutting Ideas for Computational Climate Science

This report presents results from the DOE-sponsored workshop titled, Advancing X-Cutting Ideas for Computational Climate Science Workshop,'' known as AXICCS, held on September 12--13, 2016 in Rockville, MD. The workshop brought together experts in climate science, computational climate science, computer science, and mathematics to discuss interesting but unsolved science questions regarding climate modeling and simulation, promoted collaboration among the diverse scientists in attendance, and brainstormed about possible tools and capabilities that could be developed to help address them. Emerged from discussions at the workshop were several research opportunities that the group felt could advance climate science significantly. These include (1) process-resolving models to provide insight into important processes and features of interest and inform the development of advanced physical parameterizations, (2) a community effort to develop and provide integrated model credibility, (3) including, organizing, and managing increasingly connected model components that increase model fidelity yet complexity, and (4) treating Earth system models as one interconnected organism without numerical or data based boundaries that limit interactions. The group also identified several cross-cutting advances in mathematics, computer science, and computational science that would be needed to enable one or more of these big ideas. It is critical to address the need for organized, verified, and optimized software, which enables the models to grow and continue to provide solutions in which the community can have confidence. Effectively utilizing the newest computer hardware enables simulation efficiency and the ability to handle output from increasingly complex and detailed models. This will be accomplished through hierarchical multiscale algorithms in tandem with new strategies for data handling, analysis, and storage. These big ideas and cross-cutting technologies for enabling breakthrough climate simulation advancements also need the "glue" of outreach and learning across the scientific domains to be successful. The workshop identified several strategies to allow productive, continuous engagement across those who have a broad knowledge of the various angles of the problem. Specific ideas to foster education and tools to make material progress were discussed. Examples include follow-on cross-cutting meetings that enable unstructured discussions of the types this workshop fostered. A concerted effort to recruit undergraduate and graduate students from all relevant domains and provide them experience, training, and networking across their immediate expertise is needed. This will broaden and expand their exposure to the future needs and solutions, and provide a pipeline of scientists with a diversity of knowledge and know-how. Providing real-world experience with subject matter experts from multiple angles may also motivate the students to attack these problems and even come up with the missing solutions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Full Integration of Lipidomics Data into Multi-OMIC Functional Enrichment

Lipids have numerous roles critical to living systems. Many of these vital functions are tightly linked or regulated by proteins. Even though the function of many lipid-related enzymes is known, direct links between most individual lipid species and the enzymes that metabolize them are severely lacking. This missing connection impedes biological progress. A resource that allows users to quickly identify protein-lipid relationships will advance our understanding of lipid homeostasis and metabolic perturbed systems. Databases are readily available for mapping small molecule metabolites (i.e., polar metabolites) and specific oxidized fatty acid lipids (e.g., arachidonic acid derivatives) to proteins/enzymes known to be directly involved in metabolism of these molecules (e.g. SMPDB, Reactome, HMDB, BioCyc). This enables the integration of metabolite and protein (as well as transcript) data when performing functional enrichment and metabolic modeling allowing researchers to rapidly examine metabolic pathways from multiple omics sources. Currently, linking lipidomics data with proteomics data is conducted using a time-intensive, user defined, manual process. Here we propose creating a tool that will link lipidomics and proteomics data and also conduct functional enrichment analysis and visualization allowing for full statistical integration. Using text-mining approaches, we will extract lipid references from uniprot and create a database linking lipid species to enzymes directly related to their metabolism. We will also extract directional annotation, which will allow even greater specificity when linking data types and will help eliminate false positives from functional associations.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation

Non-intrusive reduced-order models (ROMs) have recently generated considerable interest for constructing computationally efficient counterparts of nonlinear dynamical systems emerging from various domain sciences. They provide a low-dimensional emulation framework for systems that may be intrinsically high-dimensional. This is accomplished by utilizing a construction algorithm that is purely data-driven. It is no surprise, therefore, that the algorithmic advances of machine learning have led to non-intrusive ROMs with greater accuracy and computational gains. However, in bypassing the utilization of an equation-based evolution, it is often seen that the interpretability of the ROM framework suffers. This becomes more problematic when black-box deep learning methods are used which are notorious for lacking robustness outside the physical regime of the observed data. In this article, we propose the use of a novel latent-space interpolation algorithm based on Gaussian process regression. Notably, this reduced-order evolution of the system is parameterized by control parameters to allow for interpolation in space. The use of this procedure also allows for a continuous interpretation of time which allows for temporal interpolation. The latter aspect provides information, with quantified uncertainty, about full-state evolution at a finer resolution than that utilized for training the ROMs. This research assesses the viability of this algorithm for an advection-dominated system given by the inviscid shallow water equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Data mining and statistical inference in selective laser melting

Selective laser melting (SLM) is an additive manufacturing process that builds a complex three-dimensional part, layer-by-layer, using a laser beam to fuse fine metal powder together. The design freedom afforded by SLM comes associated with complexity. As the physical phenomena occur over a broad range of length and time scales, the computational cost of modeling the process is high. At the same time, the large number of parameters that control the quality of a part make experiments expensive. In this paper, we describe ways in which we can use data mining and statistical inference techniques to intelligently combine simulations and experiments to build parts with desired properties. We start with a brief summary of prior work in finding process parameters for high-density parts. We then expand on this work to show how we can improve the approach by using feature selection techniques to identify important variables, data-driven surrogate models to reduce computational costs, improved sampling techniques to cover the design space adequately, and uncertainty analysis for statistical inference. Here, our results indicate that techniques from data mining and statistics can complement those from physical modeling to provide greater insight into complex processes such as selective laser melting.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Engineering the formation of spin-defects from first principles

The full realization of spin qubits for quantum technologies relies on the ability to control and design the formation processes of spin defects in semiconductors and insulators. We present a computational protocol to investigate the synthesis of point-defects at the atomistic level, and we apply it to the study of a promising spin-qubit in silicon carbide, the divacancy (VV). Our strategy combines electronic structure calculations based on density functional theory and enhanced sampling techniques coupled with first principles molecular dynamics. We predict the optimal annealing temperatures for the formation of VVs at high temperature and show how to engineer the Fermi level of the material to optimize the defect’s yield for several polytypes of silicon carbide. Our results are in excellent agreement with available experimental data and provide novel atomistic insights into point defect formation and annihilation processes as a function of temperature.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Soil water content, matric potential, carbon dioxide and oxygen concentrations, Oct 2018-Dec 2021, Slate River Floodplain, Crested Butte, Colorado

This data package includes a time series of soil sensor data (temperature, water content, bulk electrical conductivity, porewater dissolved oxygen and porewater dissolved carbon dioxide) in a vertical profile from the Slate River floodplain outside Crested Butte, Colorado, a focus field site for the SLAC Floodplain Hydro-Biogeochemistry SFA. The data was generated as part of the work targeting the overarching research question for the SLAC SFA: How do ubiquitous subsurface interfaces mediate molecular-scale biogeochemical processes and groundwater quality in floodplains and watersheds? The package includes: (1) soil temperature, volumetric water content and electrical conductivity at 40, 60 and 82.5 cm depth; (2) soil matric potential at 40, 60, 79 and 100 cm depth; (3) soil CO2 concentrations at 40, 60 and 82.5 cm depth; and (4) soil oxygen concentrations at 60, 82.5, 100, 135, 170 and 182 cm depth. Both the carbon dioxide and oxygen sensors are optical sensors that can measure the partial pressure of oxygen in both saturated and unsaturated conditions. Unfortunately, soil CO2 in the profile is unexpectedly high and above the sensor calibration range (0-25,000 ppm). In addition, soil CO2 sensors failed within a year of deployment, so we only report CO2 data from 2019-2020.Within the data package, "FLMD.csv" describes file-level metadata and "dd.csv" defines column headers and universal terms across the dataset. The data package includes 4 "*data.csv" files, one for each calendar year in the dataset. Each "*data.csv" file has a corresponding "*_InstallationMethods.csv" file that describes the location, sensor model, sensor serial number and other metadata corresponding for each measured parameter. Because sensors have been added over time, not every sensor has data dating back to Oct 2018. Note that there is a data gap over winter 2019-2020 due to a power outage. While this repository currently only contains data through December 2021, the dataset will be updated as additional years are collected and processed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Scaling Inference Using Triton to Accelerate Particle Physics at the LHC and DUNE

DUNE and the LHC experiments consist of unique and cutting-edge particle detectors that create massive, complex, and rich datasets with billions of events. They require sophisticated algorithms to reconstruct and interpret the data. Modern machine learning algorithms provide a powerful toolset to detect and classify particles, from familiar image processing convolutional neural networks to newer graph neural network architectures. A full reconstruction of these particle collisions requires novel approaches to handle the computing challenge of processing so much raw data. In a series of studies, physicists from Fermilab, CERN, and university groups explored how to accelerate their data processing using the Triton Inference Server.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

2018 Postclosure Groundwater Monitoring and Inspection Report, Central Nevada Test Area, Nevada, Subsurface Corrective Action Unit 443

This report presents the groundwater monitoring data collected by the U.S. Department of Energy (DOE) Office of Legacy Management (LM) from the Central Nevada Test Area (CNTA), Nevada, Site, Subsurface Corrective Action Unit (CAU) 443 in Nye County, Nevada (Figure 1). CNTA is the site of an underground nuclear test in 1968 that resulted in residual contamination near the detonation depth of 3200 feet (ft); the contamination requires long-term monitoring. Responsibility for the environmental restoration and long-term monitoring was transferred from DOE’s National Nuclear Security Administration, Nevada Field Office, to LM on October 1, 2006. The environmental restoration and site closure process were completed in 2015 in accordance with the amended Federal Facility Agreement and Consent Order (FFACO) (FFACO 1996, as amended) and all applicable Nevada Division of Environmental Protection (NDEP) policies and regulations. The Closure Report, Central Nevada Test Area, Subsurface Corrective Action, Unit 443 (DOE 2018a), also called the Closure Report, originally was completed in January 2016 and revised in October 2018; it describes LM’s plan for long-term postclosure monitoring. This includes monitoring of the radioisotopes of interest and water elevations, inspecting the site and maintaining the institutional controls (ICs), evaluating and reporting data, and documenting the site’s records and data management processes (DOE 2018a).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Chlamydomonas reinhardtii responses to Fe-excess, Fe-deficiency, and Fe-limitation in either photoautotrophic or mixotrophic growth

A systems level analysis of Chlamydomonas reinhardtii grown photoautotrophically or mixotrophically with a reduced carbon source, acetate, under four different defined Fe stages of Fe-replete, Fe-deficient, Fe-limited, or Fe-excess. Samples were digested with trypsin, labeled with TMT 10-Plex, then analyzed by LC-MS/MS. Data was searched with MS-GF+ using PNNL's DMS Processing pipeline. [doi:10.25345/C5707X12X] [dataset license: CC0 1.0 Universal (CC0 1.0)]

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Human Primary Airway Epithelium +/- Macrophages Response to HCoV-229E Infection Transcriptomics (ACS-DP3)

The purpose of this experiment was to evaluate the human host cellular response to wild-type Human coronavirus strain 229E (HCoV-299E) infection. Sample data was obtained for mock and infected (MOI 3) primary human airway epithelial cells with and without macrophages and grown in air-liquid interface conditions. Sample data was acquired using an Illumina Hi-Seq 4000 sequencer system and further processed for RNA sequencing (RNA-Seq) expression analysis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Facilitating better and faster simulations of aerosol-cloud interactions in Earth system models

Focal Area(s): 1. Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising a hierarchy of models. 2. Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI. Science Challenge: One major challenge that Earth system models (ESMs) face in providing credible prediction of the Earth system and its water cycle characteristics (e.g., mean state, variability, and extreme events) is to accurately simulate aerosol-cloud interactions (ACI). The physical, chemical, and dynamical processes affecting ACI are extremely complex and they range from nanoscale to planetary scale. In each model development cycle, scientists spend significant efforts investigating model deficiencies and uncertainties associated with aerosols (e.g., emissions, chemical processes, aerosol microphysics, and transport) and clouds (e.g., macrophysics, microphysics, turbulence, and large-scale circulation) in order to develop improved treatments. However, despite decades of active research, ACI is still a major source of uncertainty in climate projections, even though great progress has been made. Specific scientific challenges include: (i) Parameterizations are developed based on limited data; (ii) The complexity of a parameterization required for accurate predictions is not understood; (iii) Incomplete and unknown physics leads to errors in the fully coupled Earth system; and (iv) Complex physics is computationally too expensive to employ in ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Real-time kinematic (RTK) Drone-collected Data and Processed Models of Port Arthur Coastal Neighborhood and Pleasure Island Golf Course, June 2024

The Southeast Texas Urban Integrated field lab’s Co-design team captured aerial photos in the Port Arthur Coastal Neighborhood Community and the Golf Course on Pleasure Island, Texas, in June 2024. Aerial photos taken were through autonomous flight, and models were processed through the DroneDeploy engine. All aerial photos are in .JPG format and contained in zipped files for each area. The processed data package includes 3D models, geospatial data, mappings, and point clouds. Please be aware that DTM, Elevation toolbox, Point Cloud, and Orthomosaic use EPSG: 6588. And 3D Model uses EPSG: 3857.For using these data:- The Adobe Suite gives you great software to open .Tif files.- You can use LASUtility (Windows), ESRI ArcGIS Pro (Windows), or Blaze3D (Windows, Linux) to open a LAS file and view the data it contains.- Open an .OBJ file with a large number of free and commercial applications. Some examples include Microsoft 3D Builder, Apple Preview, Blender, and Autodesk.- You may use ArcGIS, Merkaartor, Blender (with the Google Earth Importer plug-in), Global Mapper, and Marble to open .KML files.- The .tfw world file is a text file used to georeference the GeoTIFF raster images, like the orthomosaic and the DSM. You need suitable software like ArcView to open a .TFW file.This dataset provides researchers with sufficient geometric data and the status quo of the land surface at the locations mentioned above. This dataset will support researchers' decision-making processes under uncertainties.

2D mapping↗