Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

KBase partners with community developers from several Department of Energy Science Focus Areas to increase functionality of tools and analysis

Several SFAs were selected for training on the KBase Software Development Kit (SDK) to integrate tools and data into the KBase platform. Overall, the collaborative effort was viewed as highly successful. Every SFA project was able to achieve their proposed targets for training and functionality, while also gaining an appreciation for the role KBase plays/could play in their future science plans. Both the SFA and KBase teams felt that continued collaboration would be beneficial, especially if the programs were able to jointly prioritize scope and readiness of future projects. This poster will outline the scope of functionality added by SFA community developers, and highlight points of intersection across these efforts.

59 BASIC BIOLOGICAL SCIENCES↗

IMS - MS Data Extractor

An automated drift time extraction and computed associated collision cross section software tool for small molecule analysis with ion mobility spectrometry-mass spectrometry (IMS-MS). The software automatically extracts drift times and computes associated collision cross sections for small molecules analyzed using ion mobility spectrometry-mass spectrometry (IMS-MS) based on a target list of expected ions provided by the user.

Source record↗

Science of the Van Allen Probes Science Operations Centers

The Van Allen Probes mission operations materialized through a distributed model in which operational responsibility was divided between the Mission Operations Center (MOC) and separate instrument specific SOCs. The sole MOC handled all aspects of telemetering and receiving tasks as well as certain scientifically relevant ancillary tasks. Each instrument science team developed individual instrument specific SOCs proficient in unique capabilities in support of science data acquisition, data processing, instrument performance, and tools for the instrument team scientists. In parallel activities, project scientists took on the task of providing a significant modeling tool base usable by the instrument science teams and the larger scientific community. With a mission as complex as Van Allen Probes, scientific inquiry occurred due to constant and significant collaboration between the SOCs and in concert with the project science team. Planned cross-instrument coordinated observations resulted in critical discoveries during the seven-year mission. Instrument cross-calibration activities elucidated a more seamless set of data products. Specific topics include post-launch changes and enhancements to the SOCs, discussion of coordination activities between the SOCs, SOC specific analysis software, modeling software provided by the Van Allen Probes project, and a section on lessons learned. One of the most significant lessons learned was the importance of the original decision to implement individual team SOCs providing timely and well-documented instrument data for the NASA Van Allen Probes Mission scientists and the larger magnetospheric and radiation belt scientific community.

47 OTHER INSTRUMENTATION↗

Analysis of X-ray images and spectra (aXis2000): A toolkit for the analysis of X-ray spectromicroscopy data

Spectromicroscopy refers to analytical methods that combine imaging and spectroscopy to provide detailed, spatially resolved analytical information about a sample, such as the type and quantitative spatial distributions of chemical components, geometric or magnetic alignment information, crystal structure, etc. The analysis of X-ray images and spectra (aXis2000) software described in this work provides a set of routines within a single, integrated, graphical-oriented package to read, display, manipulate and analyze spectromicroscopy data, with particular focus on soft X-ray spectromicroscopy methods such as scanning transmission X-ray microscopy (STXM), X-ray photoemission electron microscopy (XPEEM), scanning photoelectron X-ray microscopy (SPEM) and transmission X-ray microscopy (TXM). Here, this free software is described and compared to other software that can provide similar or complementary capabilities. Examples of spectromicroscopic analyses using advanced features of aXis2000 are provided.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Geohydrodynamic Parameters and Their Implications on the Coastal Conservation: A Case Study of Abak Local Government Area (LGA), Akwa Ibom State, Southern Nigeria

A total of 14 vertical electrical soundings using Schlumberger electrode configuration and the complementary laboratory analysis of aquifer samples were carried out in the Abak Local Government Area of Akwa Ibom State, the coastal region of Nigeria. The study focused on the estimation of geohydrodynamic parameters of the frequently exploited aquifers and the implication of hydrodynamic parameters on the lithostratigraphy and the anticipated exposure of the assessed geologic formation at the shorelines. These parameters were porosity (ϕ), tortuosity (τ), formation factor (F), aquifer water formation resistivity (R{sub w}) and coefficient of permeability/hydraulic conductivity (K). Computation of the effective porosities from the aquifer cuttings was carried out using wet weight–dry weight technique and petrophysical techniques. The F values were computed using the aquifer formation bulk resistivity measured from field 1-D resistivity data analysis, whose interpretation was constrained by nearby borehole information. The formation pore water resistivities were estimated from the laboratory using electrical resistivity metre. The Win RESIST software program was used in interpreting the field data electronically. The results of interpretation gave the primary parameters of saturated and unsaturated units of the coastal regions used in this work. The area generally shows seemingly high porosity with high coefficient of permeability. The primary and secondary parameters have been contoured to model their distributions. Besides, some functional relations have been realized through regression analyses. The contour distribution of the geohydrodynamic parameters indicates the vulnerability of the water repositories to contaminations as well as the vulnerability of the shoreline to waterborne erosion. The seemingly high effective porosity in the compliant laboratory and calculated values indicate that the coastal region is neither lithified nor compacted/consolidated. This signals the possibility of the formation to be easily eroded, weathered or flooded where these units are exposed to water current. With these revelations, the shorelines could be properly managed and conserved by geotechnically reinforcing with hard and water-resistant concrete that can protect the vulnerable and erosion-prone porous sediments.

58 GEOSCIENCES↗

Deep in Data: Empirical Data Based Software Accuracy Testing Using the Building America Field Data Repository: Preprint

An opportunity is available for using home energy consumption and building description data to develop a standardized accuracy test for residential energy analysis tools. That is, to test the ability of uncalibrated simulations to match real utility bills. Empirical data collected from around the United States have been translated into a uniform Home Performance Extensible Markup Language format that may enable software developers to create translators to their input schemes for efficient access to the data. This may facilitate the possibility of modeling many homes expediently, and thus implementing software accuracy test cases by applying the translated data. This paper describes progress toward, and issues related to, developing a usable, standardized, empirical data-based software accuracy test suite.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

artdaq : DAQ software development made simple

For a few years now, the artdaq data acquisition software toolkit has provided numerous experiments with ready-to-use components which allow for rapid development and deployment of DAQ systems. Developed within the Fermilab Scientific Computing Division, artdaq provides data transfer, event building, run control, and event analysis functionality. This latter feature includes built-in support for the art event analysis framework, allowing experiments to run art modules for real-time filtering, compression, disk writing and online monitoring; as art, also developed at Fermilab, is also used for online analysis, a major advantage of artdaq is that it allows developers to easily switch between developing online and online software. artdaq continues to be improved. Support for an alternate mode of running whereby data from some subdetector components are only streamed if requested has been added; this option will reduce unnecessary DAQ throughput. Real-time reporting of DAQ metrics has been implemented, along with the flexibility to choose the format through which experiments receive the reports; these formats include the Ganglia, Graphite and syslog software packages, along with at ASCII files. Additionally, work has been performed investigating more flexible modes of online monitoring, including the capability of being able to run multiple online monitoring processes on different hosts, each running its own set of art modules. Finally, a web-based GUI interface through which users can configure details of their DAQ system has been implemented, increasing the ease of use of the system. Already successfully deployed on the LArIAT, DarkSide-50, DUNE 35ton and Mu2e experiments, artdaq will be employed for SBND and is a strong candidate for use on ICARUS and protoDUNE. With each experiment comes new ideas for how artdaq can be made more flexible and powerful; the above improvements will be described, along with potential ideas for the future.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

IDEAL: Images Across Domains, Experiments, Algorithms and Learning

Research across science domains is increasingly reliant on image-centric data. Software tools are in high demand to uncover relevant, but hidden, information in digital images, such as those coming from faster next generation high-throughput imaging platforms. The challenge is to analyze the data torrent generated by the advanced instruments efficiently, and provide insights such as measurements for decision-making. In this article, we overview work performed by an interdisciplinary team of computational and materials scientists, aimed at designing software applications and coordinating research efforts connecting (1) emerging algorithms for dealing with large and complex datasets; (2) data analysis methods with emphasis in pattern recognition and machine learning; and (3) advances in evolving computer architectures. Engineering tools around these efforts accelerate the analyses of image-based recordings, improve reusability and reproducibility, scale scientific procedures by reducing time between experiments, increase efficiency, and open opportunities for more users of the imaging facilities. This paper describes our algorithms and software tools, showing results across image scales, demonstrating how our framework plays a role in improving image understanding for quality control of existent materials and discovery of new compounds.

97 MATHEMATICS AND COMPUTING↗

TagDigger: user-friendly extraction of read counts from GBS and RAD-seq data

In genotyping-by-sequencing (GBS) and restriction site-associated DNA sequencing (RAD-seq), read depth is important for assessing the quality of genotype calls and estimating allele dosage in polyploids. However, existing pipelines for GBS and RAD-seq do not provide read counts in formats that are both accurate and easy to access. Additionally, although existing pipelines allow previously-mined SNPs to be genotyped on new samples, they do not allow the user to manually specify a subset of loci to examine. Pipelines that do not use a reference genome assign arbitrary names to SNPs, making meta-analysis across projects difficult. We created the software TagDigger, which includes three programs for analyzing GBS and RAD-seq data. The first script, tagdigger_interactive.py, rapidly extracts read counts and genotypes from FASTQ files using user supplied sets of barcodes and tags. Input and output is in CSV format so that it can be opened by spreadsheet software. Tag sequences can also be imported from the Stacks, TASSEL-GBSv2, TASSEL-UNEAK, or pyRAD pipelines, and a separate file can be imported listing the names of markers to retain. A second script, tag_manager.py, consolidates marker names and sequences across multiple projects. A third script, barcode_splitter.py, assists with preparing FASTQ data for deposit in a public archive by splitting FASTQ files by barcode and generating MD5 checksums for the resulting files. TagDigger is open-source and freely available software written in Python 3. It uses a scalable, rapid search algorithm that can process over 100 million FASTQ reads per hour. TagDigger will run on a laptop with any operating system, does not consume hard drive space with intermediate files, and does not require programming skill to use.

59 BASIC BIOLOGICAL SCIENCES↗

Progress Report, December 2010: Improved Site Characterization And Storage Prediction Through Stochastic Inversion Of Time-Lapse Geophysical And Geochemical Data

Over the last project six months, our project activities have concentrated on three areas: (1) performing a stochastic inversion of pattern 16 seismic data to deduce reservoir permeability, (2) development of the geochemical inversion strategy and implementation of associated software, and (3) completing the software implementation of TProGS and the geostatistical analysis that provides the information needed when using the software to produce realizations of the Midale reservoir. The report partially the following deliverables: D2: Model development: MCMC tool (synthetic fluid chemistry data); deliverable completed. D4: Model development/verification: MCMC tool (TProGS, field seismic/chemistry data) work product; deliverable requirements partially fulfilled. D5: Field-based single-pattern simulations work product; deliverable requirements partially fulfilled. When completed, our completed stochastic inversion tool will explicitly integrate reactive transport modeling, facies-based geostatistical methods, and a novel stochastic inversion technique to optimize agreement between observed and predicted storage performance. Such optimization will be accomplished through stepwise refinement of: (1) the reservoir model - principally its permeability magnitude and heterogeneity - and (2) geochemical parameters - primarily key mineral volume fractions and kinetic data. We anticipate that these refinements will facilitate significantly improved history matching and forward modeling of CO{sub 2} storage. Our tool uses the Markov Chain Monte Carlo (MCMC) methodology. Deliverable D1, previously submitted as a report titled ''Development of a Stochastic Inversion Tool To Optimize Agreement Between The Observed And Predicted Seismic Response To CO{sub 2} Injection/Migration in the Weyburn-Midale Project'' (Ramirez et al., 2009), described the stochastic inversion approach that will identify reservoir models that optimize agreement between the observed and predicted seismic response. The software that implements this approach has been completed, tested, and used to process seismic data from pattern 16. A previously submitted report titled ''Model verification: synthetic single pattern simulations using seismic reflection data'', Ramirez et al. 2010, partially fulfilled deliverable D3 by summarizing verification activities that evaluate the performance of the seismic software and its ability to recover reservoir model permeabilities using synthetic seismic reflection data. A future progress report will similarly describe summarizing verification activities of the geochemical inversion software, thereby completing deliverable D3. This document includes a chapter that shows and discusses permeability models produced by seismic inversion that used seismic data from pattern 16 in Phase 1A. It partially fulfills deliverable D5: Field-based single-pattern simulations work product. The D5 work product is supposed to summarize the results of applying NUFT/MCMC to refine the reservoir model and geochemical parameters by optimizing observation/prediction agreement for the seismic/geochemical response to CO{sub 2} injection/migration within a single pattern of Phase 1A/1B. A future progress report will show inversion results for the same pattern using geochemical data, thereby completing deliverable D5. This document also contains a chapter that fulfills deliverable D2: Model development: MCMC tool (synthetic fluid chemistry data). The chapter will summarize model development activities required to facilitate application of NUFT/MCMC to optimize agreement between the observed and predicted geochemical response to CO{sub 2} injection/migration. Lastly, this document also contains a chapter that partially fulfills deliverable D4: Model development/verification: MCMC tool (TProGS, field seismic/chemistry data) work product. This work product is supposed to summarize model development activities required for (1) application of TProGS to Weyburn, (2) use of TProGS within the MCMC tool, and (3) application of the MCMC tool to address field seismic and geochemical data. The chapter included here fulfills requirements 1 and 2. Requirement 3 will be addressed in a future progress report.

58 GEOSCIENCES↗

Experimental Soil Warming Impacts Soil Moisture and Plant Water Stress and Thereby Ecosystem Carbon Dynamics (Blodgett, CA)

This dataset contains data on daily soil temperature, moisture and flux, and soil carbon stock and root biomass across a soil profile down to 100 cm depth at Blodgett Forest Research Station, CA, USA. These data were generated to determine if modeling of an experimental soil warming of 4C showed increased soil CO2 emissions and changes in bulk soil carbon stocks with depth consistent with field observations, as part of the study: Riley et al. (2025) Experimental Soil Warming Impacts Soil Moisture and Plant Water Stress and Thereby Ecosystem Carbon Dynamics in Journal of Advances in Modeling Earth Systems. This research was performed within the framework of the TES Belowground Biogeochemistry SFA project, in particular association with a 1 m-deep experimental soil heating experiment at the University of California Blodgett Forest Research Station, California (120 ° 39′40′′W; 38 ° 54′43′′N). Continuous data were collected at the plot level, and bulk soil carbon and root biomass were sampled once a year from each plot from 0-100 cm, in 10 cm intervals. Measurements relevant to the current study include soil temperature and soil volumetric water content measured continuously at multiple depths in the top meter; fine root biomass and SOC stocks measured from annual soil cores. Soil flux was continuously monitored using a LI-8100 Automated CO2 Flux System in conjunction with the LI-8150 Multiplexer (Licor, Nebraska, USA). Soil flux was determined using SoilFluxPro software, with flux values showing an R² fit of less than 0.9 being excluded from the analysis. Data were collected from each paired plot (1-3): one control (C) and one heated (H).

54 ENVIRONMENTAL SCIENCES↗

A Unified Data-Driven Approach for Programming In Situ Analysis and Visualization: An Interim Report of Sandia Sub-Team Contributions

As we look ahead to next generation high performance computing platforms, the placement and movement of data is becoming the key-limiting factor on both performance and energy efficiency. Furthermore, the increased quantities of data the systems are capable of generating, in conjunction with the insufficient rate of improvements in the supporting I/0 infrastructure, is forcing applications away from the off-line post-processing of data towards techniques based on in ,situ analysis and visualization. Together, these challenges are shaping how we will both design and develop effective, performant and energy-efficient software. In particular, the challenges highlight the need for data and data-centric operations to be fundamental in the reasoning about, and optimization of, scientific workflows on extreme-scale architectures.

97 MATHEMATICS AND COMPUTING↗

Synthesis of nano-forsterite powder by making use of natural silica sand

Nano-forsterite powder with natural silica sand and magnesium powder as the raw materials have been succesfully synthesized. The silica sand was purified followed by a coprecipitation process to obtain colloidal silica. The magnesium powder was dissolved in a chloric acid solution to obtain MgCl{sub 2} solution. The nanoforsterite powder was synthesised using a sol-gel method which included the mixing the colloidal silica and the MgCl{sub 2} solution with various aging and filtering processes. The samples were dried at 100 °C using a hot plate and then the dried powders were calcinated at 900 °C for 2 hours. The samples were characetised for their elements and phase compositions using X-ray Flourescence (XRF) and X-ray Diffraction (XRD) methods, respectively. The diffraction data were qualitatively analyzed using Match!2 software and quantitatively using Rietica software. The crystallite size was verified using Transmission Electron Microscopy (TEM). Results of XRD data analysis showed that the forsterite content reached up to 90.5% wt. The TEM average crystallite size was approximately 53(6) nm.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Practical galaxy morphology tools from deep supervised representation learning

Astronomers have typically set out to solve supervised machine learning problems by creating their own representations from scratch. We show that deep learning models trained to answer every Galaxy Zoo DECaLS question learn meaningful semantic representations of galaxies that are useful for new tasks on which the models were never trained. We exploit these representations to outperform several recent approaches at practical tasks crucial for investigating large galaxy samples. The first task is identifying galaxies of similar morphology to a query galaxy. Given a single galaxy assigned a free text tag by humans (e.g. ‘#diffuse’), we can find galaxies matching that tag for most tags. The second task is identifying the most interesting anomalies to a particular researcher. Our approach is 100 per cent accurate at identifying the most interesting 100 anomalies (as judged by Galaxy Zoo 2 volunteers). The third task is adapting a model to solve a new task using only a small number of newly labelled galaxies. Models fine-tuned from our representation are better able to identify ring galaxies than models fine-tuned from terrestrial images (ImageNet) or trained from scratch. We solve each task with very few new labels; either one (for the similarity search) or several hundred (for anomaly detection or fine-tuning). This challenges the longstanding view that deep supervised methods require new large labelled data sets for practical use in astronomy. To help the community benefit from our pretrained models, we release our fine-tuning code zoobot. Zoobot is accessible to researchers with no prior experience in deep learning.

79 ASTRONOMY AND ASTROPHYSICS↗

PNNL OMICS

The PNNL Omics Library (PNNLOmics.dll) is a collection of data analysis, file I/O, and visualization routines used by several of the omics-related software developed at PNNL.

Degan, Michael↗

Visualization Quality Assessment

Understanding how inaccuracies in visualizations affect users’ perception and understanding of scientific data is hard. Inaccuracies in visualizations are quite common and could arise from a range of sources such as errors in the original dataset arising from compression artifacts, errors in the capturing device, noise during transmission of the data, effects due to the algorithm being used to convert data to visualization images, images generated from neural networks, and sources we have yet to discover. Many image quality assessment metrics have been developed to quantify image errors. However, these are usually focused on “natural images” rather than visualizations of scientific data. Common image quality assessment metrics (IQAs) include MSE, PSNR, perceptual metrics such SSIM, FSIM as well as perceptual metrics using deep learning approaches. However, a critical part of understanding how errors are perceived by humans, and subsequently developing more accurate quality assessment metrics, is through user evaluation studies. The goal of this software is to develop a visualization quality assessment (VQA) process that will enable the generation of VQAs that can be used to quantify errors in scientific data visualizations. The VQA development process will include software to support user evaluation experimental design, analysis of visualization differences against standard quality metrics, and the ability to develop additional VQA metrics specific to scientific visualization images.

Grosset, Andre↗

Sierra Toolkit Manual Version 4.48

This report provides documentation for the SIERRA Toolkit (STK) modules. STK modules are intended to provide infrastructure that assists the development of computational engineering software such as finite-element analysis applications. STK includes modules for unstructured-mesh data structures, reading/writing mesh files, geometric proximity search, and various utilities. This document contains a chapter for each module, and each chapter contains overview descriptions and usage examples. Usage examples are primarily code listings which are generated from working test programs that are included in the STK code-base. A goal of this approach is to ensure that the usage examples will not fall out of date. This page intentionally left blank.

97 MATHEMATICS AND COMPUTING↗