Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Jas4pp — A data-analysis framework for physics and detector studies

This paper describes the Jas4pp framework for exploring physics cases and for detector-performance studies of future particle collision experiments. Jas4pp is a multi-platform Java program for numeric calculations, scientific visualization in 2D and 3D, storing data in various file formats and displaying collision events and detector geometries. It also includes complex data-analysis algorithms for function minimization, regression analysis, event reconstruction (such as jet reconstruction), limit settings and other libraries widely used in particle physics. The framework can be used with several scripting languages, such as Python/Jython, Groovy and JShell. Several benchmark tests discussed in the paper illustrate significant improvements in the performance of the Groovy and JShell scripting languages compared to the standard Python implementation in C. Furthermore, the improvements for numeric computations in Java are attributed to recent enhancements in the Java Virtual Machine.

97 MATHEMATICS AND COMPUTING↗

PECAN: library-free peptide detection for data-independent acquisition tandem mass spectrometry data

Data-independent acquisition (DIA) is an emerging mass spectrometry (MS)-based technique for unbiased and reproducible measurement of protein mixtures. DIA tandem mass spectrometry spectra are often highly multiplexed, containing product ions from multiple cofragmenting precursors. Detecting peptides directly from DIA data is therefore challenging; most DIA data analyses require spectral libraries. Here we present PECECAN (http://pecan.maccosslab.org), a library-free, peptide-centric tool that robustly and accurately detects peptides directly from DIA data. PECECAN reports evidence of detection based on product ion scoring, which enables detection of low-abundance analytes with poor precursor ion signal. We demonstrate the chromatographic peak picking accuracy and peptide detection capability of PECECAN, and we further validate its detection with data-dependent acquisition and targeted analyses. Lastly, we used PECECAN to build a plasma proteome library from DIA data and to query known sequence variants.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

BiG-SLiCE 2 v1.0.0

BiG-SLiCE was originally an open source Python-based command line bioinformatics software that offers a highly scalable clustering analysis on biosynthetic gene clusters (BGC) data. It allows a simultaneous analysis of millions of BGCs, exceeding the capability of other existing tools (around one hundred thousands). As a tradeoff, the clustering accuracy is relatively lower and sometimes fall short in corner cases and specific BGC classes such as the RiPPs (Ribosomally-translated, Post-translationally modified Peptides). In BiG-SLiCE V2 (developed in LBNL), the clustering algorithm has been significantly improved to deliver a much accurate result even for RiPPs and other previous corner case classes. Moreover, the speed of the overall pipeline has been improved by 50-100%. Finally, additional features were implemented to support downstream analyses of BiG-SLiCE results, such as customized tabular (TSV/CSV) and columnar (Parquet) outputs.

Kautsar, Satria↗

Materials Challenges and Opportunities for Energy Generation, Conversion, Delivery, and Storage (Applied Energy Tri-Laboratory Consortium Workshop Report)

This report documents the outcomes of the Tri-Laboratory Materials Workshop that was held July 31 and August 1, 2019 to begin addressing the needs, opportunities, and challenges associated with the development, fabrication, and testing of the needed materials and components for integrated hybrid energy systems (i.e., incorporating nuclear, fossil, and renewables for electric and thermal applications). This was accomplished by assembling the research program leads and principal investigators at Idaho National Laboratory (INL), National Energy Technology Laboratory (NETL), and National Renewable Energy Laboratory (NREL), who support the research and development of new technology and system integration. The team then identified and prioritized key materials development needs. This effort was intended to enhance communications and synergy among the Tri-Lab partners. Advanced functional and structural materials are central to transformative energy technologies for energy generation, conversion, delivery, and storage. With that in mind, the workshop focused on identifying and assessing the foundational materials research needs at both the basic and applied levels. Materials challenges include the ability to withstand harsh environments, such as high temperatures and pressures, corrosion, oxidation, or irradiation while maintaining flexible mission profiles and long service lifespans. Advanced energy system material challenges and needs range from materials for the capture, upgrading/concentration, storage, and delivery of low-grade heat to materials for high temperature environments that involve liquid metals, molten salt, and very high temperature gas heat delivery and storage systems. Material improvements are needed for hybrid energy systems due to accelerated corrosion and stress-fatigue failure of materials and equipment, which results from increased frequency and amplitude of thermal, mechanical, and electrical cycling of systems components. Multifunctional materials are needed for high temperature solid-oxide fuel cells, advanced electrochemical reactors, and in-process separation. Relative to materials manufacturing, application of advanced additive and subtractive methods need to be understood to develop both thin-layer homogenous materials and materials of graded composition. Materials modeling and machine learning will be critical to accelerate the design and production of power electronics, and nuclear reactor materials and fuel, as well as to gain an understanding of beneficial materials phenomena or deleterious microstructure evolution. There is also a need for standardized models, computational structures, data reporting protocols and modeling tools across the three laboratories. This would allow consistent results, analysis, and data sharing. Combining computational capabilities between the three laboratories (e.g., hardware, software) would greatly increase computational capabilities and throughput. The workshop identified the need for laboratories to anticipate and address problems that will occur during scale-up. Laboratory work must connect with industry to ensure that research focuses on processes that are scalable and marketable. Industry input and perspective are essential to guide laboratory research to meet these requirements and deploy new technology in industrial demonstrations. Another aspect of scale-up is the integration of multiple systems since new challenges often arise at the subsystem interfaces. Establishing a scale-up manufacturing demonstration/pilot plant, potentially as an industrial user facility, would be beneficial to the laboratories and industry. That modular scale-up manufacturing demonstration/pilot plant would allow researchers to find and resolve interface problems that cannot be identified by focusing only on individual parts. Communication exchanges among the organizers, attendees, and workshop survey responses indicate that the workshop was successful in achieving its goal to identify key technology gaps and research needs. Strong positive feedback was received on the sharing of ideas, capabilities, talent, and passion to move forward on the materials-related action items.

36 MATERIALS SCIENCE↗

The Early Data Release of the Dark Energy Spectroscopic Instrument

The Dark Energy Spectroscopic Instrument (DESI) completed its 5 month Survey Validation in 2021 May. Spectra of stellar and extragalactic targets from Survey Validation constitute the first major data sample from the DESI survey. This paper describes the public release of those spectra, the catalogs of derived properties, and the intermediate data products. In total, the public release includes good-quality spectral information from 466,447 objects targeted as part of the Milky Way Survey, 428,758 as part of the Bright Galaxy Survey, 227,318 as part of the Luminous Red Galaxy sample, 437,664 as part of the Emission Line Galaxy sample, and 76,079 as part of the Quasar sample. In addition, the release includes spectral information from 137,148 objects that expand the scope beyond the primary samples as part of a series of secondary programs. Here, we describe the spectral data, data quality, data products, Large-Scale Structure science catalogs, access to the data, and references that provide relevant background to using these spectra.

79 ASTRONOMY AND ASTROPHYSICS↗

National Geothermal Data System: Case Studies on Exploration and Development of Potential Geothermal Sites Through Distributed Data Sharing

The NGDS released version 1 of the system on April 30, 2014 using the US Geoscience Information Network (USGIN) as its data integration platform. NGDS supports the 2013 Open Data Policy, and as such, the launch was featured at the 2014 Energy Datapalooza. Currently, the NGDS features a comprehensive user interface for searching and accessing nearly 41,000 documents and more than 9 million data points shared by scores of data providers across the U.S. The NGDS supports distributed data sharing, permitting the data owners to maintain the raw data that is made available to the consumer. Researchers and industry have been utilizing the NGDS as a mechanism for promoting geothermal development across the country, from hydrothermal to ground source heat pump applications. Case studies in geothermal research and exploration from across the country are highlighted.

15 GEOTHERMAL ENERGY↗

Beholder Intrusion Detection System Client

Malicious software is capable of hiding itself on a system using the system's own functionality (i.e. system call hooking, interrupt handling, etc.). Hiding requires the use of resources, enabling Beholder to detect the presence of malicious software from the changes in the timing data of critical system functions. The software installs a client, which continually sends analysis reports to a server. The server does post-processing and determines if infection has occurred on the client.

Ferber, Aaron E↗

A Single Tower Configuration of the Modular Gamma Box Counter System - 13392

Canberra's Standard Gamma Box Counter System is designed to perform accurate quantitative assays of gamma emitting nuclides for a wide range of large containers including B-25 crates and ISO shipping containers. Using a modular building-block approach, the system offers tremendous flexibility for a variety of measurement situations with wide ranges of sample activities and throughput requirements, as well as the opportunity to modify the configuration for other applications at a later date. The typical configuration consists of two opposing towers each equipped with two high purity germanium detectors, and an automated container trolley. This paper presents a modified configuration, consisting of a single tower placed inside a measurement trailer with three detector assemblies, allowing for additional vertical segmentation as well as a viewing a container outside the trailer through the trailer wall. An automatic liquid nitrogen fill system is supplied for each of the detectors. The use of a forklift to move the container for horizontal segmentation is accommodated by creating an additional operational and calibration set-up in the NDA 2000 software to allow for the operator to rotate the container and assay the opposite side, achieving the same sensitivity as a comparable two-tower system. This Segmented Gamma Box Counter System retains the core technologies and design features of the standard configuration. The detector assemblies are shielded to minimize interference from environmental and plant background, and are collimated to provide segmentation of the container. The assembly positions can also be modified in height and distance from the container. The ISOCS calibration software provides for a flexible approach to providing the calibrations for a variety of measurement geometries. The NDA 2000 software provides seamless operation with the current configuration, handling the data acquisition and analysis. In this paper, an overview of this system is discussed, along with the measured performance results, calibration methodology and verification, and minimum detectable activity levels. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Microstructural Characterization of Irradiated Fuels and Materials for the United States High Performance Research Reactor Fuel Development Program and the Fuel Cycle Research and Development Program

In an effort to contribute to the development of advanced nuclear fuel for research reactors, monolithic and dispersion plate fuels will be examined to determine how irradiation parameters such as fission density, fission rate, and irradiation temperature, as well as mechanical parameters such as composition and fabrication, affect the final microstructure of the fuel, post irradiation. Electron Backscatter Detection (EBSD) analysis capabilities of irradiated materials will be developed as well as improvements on irradiated sample preparation in order to provide higher quality samples for SEM, FIB, and TEM. In addition, image analysis techniques developed at Idaho National Laboratory (INL) will be employed to examine microstructural features such as fission product precipitates and fission gas bubbles. The main goals are to further develop EBSD capabilities on irradiated material; characterize microstructure of irradiated fuel to support qualification; develop a consistent, effective process for image analysis using INL developed software; and provide repeatable, statistically-confident, critically assessed data to further modeling efforts. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Automated Cache Performance Analysis And Optimization

While there is no lack of performance counter tools for coarse-grained measurement of cache activity, there is a critical lack of tools for relating data layout to cache behavior to application performance. Generally, any nontrivial optimizations are either not done at all, or are done ”by hand” requiring significant time and expertise. To the best of our knowledge no tool available to users measures the latency of memory reference instructions for particular addresses and makes this information available to users in an easy-to-use and intuitive way. In this project, we worked to enable the Open|SpeedShop performance analysis tool to gather memory reference latency information for specific instructions and memory addresses, and to gather and display this information in an easy-to-use and intuitive way to aid performance analysts in identifying problematic data structures in their codes. This tool was primarily designed for use in the supercomputer domain as well as grid, cluster, cloud-based parallel e-commerce, and engineering systems and middleware. Ultimately, we envision a tool to automate optimization of application cache layout and utilization in the Open|SpeedShop performance analysis tool. To commercialize this software, we worked to develop core capabilities for gathering enhanced memory usage performance data from applications and create and apply novel methods for automatic data structure layout optimizations, tailoring the overall approach to support existing supercomputer and cluster programming models and constraints. In this Phase I project, we focused on infrastructure necessary to gather performance data and present it in an intuitive way to users. With the advent of enhanced Precise Event-Based Sampling (PEBS) counters on recent Intel processor architectures and equivalent technology on AMD processors, we are now in a position to access memory reference information for particular addresses. Prior to the introduction of PEBS counters, cache behavior could only be measured reliably in the aggregate across tens or hundreds of thousands of instructions. With the newest iteration of PEBS technology, cache events can be tied to a tuple of instruction pointer, target address (for both loads and stores), memory hierarchy, and observed latency. With this information we can now begin asking questions regarding the efficiency of not only regions of code, but how these regions interact with particular data structures and how these interactions evolve over time. In the short term, this information will be vital for performance analysts understanding and optimizing the behavior of their codes for the memory hierarchy. In the future, we can begin to ask how data layouts might be changed to improve performance and, for a particular application, what the theoretical optimal performance might be. The overall benefit to be produced by this effort was a commercial quality easy-to- use and scalable performance tool that will allow both beginner and experienced parallel programmers to automatically tune their applications for optimal cache usage. Effective use of such a tool can literally save weeks of performance tuning effort. Easy to use. With the proposed innovations, finding and fixing memory performance issues would be more automated and hide most to all of the performance engineer expertise ”under the hood” of the Open|SpeedShop performance tool. One of the biggest public benefits from the proposed innovations is that it makes performance analysis more usable to a larger group of application developers. Intuitive reporting of results. The Open|SpeedShop performance analysis tool has a rich set of intuitive, yet detailed reports for presenting performance results to application developers. Our goal was to leverage this existing technology to present the results from our memory performance addition to Open|SpeedShop. Suitable for experts as well as novices. Application performance is getting more difficult to measure as the hardware platforms they run on become more complicated. This makes life difficult for the application developer, in that they need to know more about the hardware platform, including the memory system hierarchy, in order to understand the performance of their application. Some application developers are comfortable in that sceario, while others want to do their scientific research and not have to understand all the nuances in the hardware platform they are running their application on. Our proposed innovations were aimed to support both experts and novice performance analysts. Useful in many markets. The enhancement to Open|SpeedShop would appeal to a broader market space, as it will be useful in scientific, commercial, and cloud computing environments. Our goal was to use technology developed initially at the and Lawrence Livermore National Laboratory combined with the development and commercial software experience of the Argo Navis Technologies, LLC (ANT) to form a powerful combination to delivery these objectives.

97 MATHEMATICS AND COMPUTING↗

PSTN-019: The LSST Science Pipelines Software: Optical Survey Pipeline Reduction and Analysis Environment

The NSF-DOE Vera C. Rubin Observatory is executing the Legacy Survey of Space and Time (LSST) as its prime mission, producing a series of data releases over the ten-year survey. The LSST Science Pipelines Software will be used to create these data releases and to perform the nightly prompt processing and alert production. This paper provides an overview of the LSST Science Pipelines Software, describing the components and their integration into pipelines that generate science-ready data products.

79 ASTRONOMY AND ASTROPHYSICS↗

Integrated System Planning: Emerging Software Requirements in the Power Industry

Power system planning software remains fragmented across organizational boundaries, with specialized tools for capacity expansion, production cost modeling, power flow, and dynamic analysis operating on incompatible data models and assumptions. This article argues that the fragmentation is not merely a technical problem but a predictable consequence of Conway's law: software architectures mirror the departmental structures within which they are developed. Regulatory milestones like Federal Energy Regulatory Commission (FERC) Order 888 formalized these divisions, but the roots trace back to the distinct engineering disciplines-mechanical, chemical, and electrical-that staffed generation and transmission planning departments in vertically integrated utilities. As the industry moves toward integrated system planning (ISP) that coordinates generation, transmission, and distribution investment decisions, the software ecosystem must evolve accordingly. We identify five categories of software requirements to enable this transition: coherent data inputs decoupled from individual applications, unified and extensible data schemas, modular component representations that support multiple abstraction levels, lifecycle management of planning datasets, and well-defined application programming interface (API) contracts that separate data exchange from algorithmic control. We examine how these requirements interact with three common workflow patterns-serial gate clearing, sequential multiapplication, and convergence oriented-and discuss the interface design principles each demands. We then outline a vision for platform-based planning architectures where specialized analytical services compose through standardized interfaces and where artificial intelligence (AI)/machine learning (ML) tools augment decision support within a disciplined software infrastructure. The practices proposed here offer a path from today's siloed tool collections toward collaborative planning ecosystems capable of handling the complexity of modern power system transformation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Enabling High Performance Application I/O

This work provides software that enables scientific applications to more efficiently access available storage resources at different levels of interfaces. We developed scalable techniques and optimizations for PVFS parallel file systems, MPI I/O, and parallel netCDF I/O library. These implementations were evaluated using production application I/O kernels as well as popular I/O benchmarks and demonstrated promising results. The software developed under this work has been made available to the public via MCS, ANL web sites.

97 MATHEMATICS AND COMPUTING↗

CMS Analysis and Data Reduction with Apache Spark

Experimental Particle Physics has been at the forefront of analyzing the world's largest datasets for decades. The HEP community was among the first to develop suitable software and computing tools for this task. In recent times, new toolkits and systems for distributed data processing, collectively called "Big Data" technologies have emerged from industry and open source projects to support the analysis of Petabyte and Exabyte datasets in industry. While the principles of data analysis in HEP have not changed (filtering and transforming experiment-specific data formats), these new technologies use different approaches and tools, promising a fresh look at analysis of very large datasets that could potentially reduce the time-to-physics with increased interactivity. Moreover these new tools are typically actively developed by large communities, often profiting of industry resources, and under open source licensing. These factors result in a boost for adoption and maturity of the tools and for the communities supporting them, at the same time helping in reducing the cost of ownership for the end-users. In this talk, we are presenting studies of using Apache Spark for end user data analysis. We are studying the HEP analysis workflow separated into two thrusts: the reduction of centrally produced experiment datasets and the end-analysis up to the publication plot. Studying the first thrust, CMS is working together with CERN openlab and Intel on the CMS Big Data Reduction Facility. The goal is to reduce 1 PB of official CMS data to 1 TB of ntuple output for analysis. We are presenting the progress of this 2-year project with first results of scaling up Spark-based HEP analysis. Studying the second thrust, we are presenting studies on using Apache Spark for a CMS Dark Matter physics search, comparing Spark's feasibility, usability and performance to the ROOT-based analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Gamma-Ray Library and Uncertainty Analysis: Passively Emitted Gamma Rays Used in Safeguards Technology

Non-destructive gamma-ray analysis is a fundamental part of nuclear safeguards, including nuclear energy safeguards technology. Developing safeguards capabilities for nuclear energy will certainly benefit from the advanced use of gamma-ray spectroscopy as well as the ability to model various reactor scenarios. There is currently a wide variety of nuclear data that could be used in computer modeling and gamma-ray spectroscopy analysis. The data can be discrepant (with varying uncertainties), and it may difficult for a modeler or software developer to determine the best nuclear data set for a particular situation. To use gamma-ray spectroscopy to determine the relative isotopic composition of nuclear materials, the gamma-ray energies and the branching ratios or intensities of the gamma-rays emitted from the nuclides in the material must be well known. A variety of computer simulation codes will be used during the development of the nuclear energy safeguards, and, to compare the results of various codes, it will be essential to have all the {gamma}-ray libraries agree. Assessing our nuclear data needs allows us to create a prioritized list of desired measurements, and provides uncertainties for energies and especially for branching intensities. Of interest are actinides, fission products, and activation products, and most particularly mixtures of all of these radioactive isotopes, including mixtures of actinides and other products. Recent work includes the development of new detectors with increased energy resolution, and studies of gamma-rays and their lines used in simulation codes. Because new detectors are being developed, there is an increased need for well known nuclear data for radioactive isotopes of some elements. Safeguards technology should take advantage of all types of gamma-ray detectors, including new super cooled detectors, germanium detectors and cadmium zinc telluride detectors. Mixed isotopes, particularly mixed actinides found in nuclear reactor streams can be especially challenging to identify. The super cooled detectors have a marked improvement in energy resolution, allowing the possibility of deconvolution of mixtures of gamma rays that was unavailable with high purity germanium detectors. Isotopic analysis codes require libraries of gamma rays. In certain situations, isotope identification can be made in the field, sometimes with a short turnaround time, depending on the choice of detector and software analysis package. Sodium iodide and high purity germanium detectors have been successfully used in field scenarios. The newer super cooled detectors offer dramatically increased resolution, but they have lower efficiency and so can require longer collection times. The different peak shapes require software development for the specific detector type and field application. Libraries can be tailored to specific scenarios; by eliminating isotopes that are certainly not present, the analysis time may be shortened and the accuracy may be increased. The intent of this project was to create one accurate library of gamma rays emitted from isotopes of interest to be used as a reliable reference in safeguards work. All simulation and spectroscopy analysis codes can draw upon this best library to improve accuracy and cross-code consistency. Modeling codes may include MCNP and COG. Gamma-ray spectroscopy analysis codes may include MGA, MGAU, U235 and FRAM. The intent is to give developers and users the tools to use in nuclear energy safeguards work. In this project, the library created was limited to a selection of actinide isotopes of immediate interest to reactor technology. These isotopes included {sup 234-238}U, {sup 237}Np, {sup 238-242}Pu, {sup 241,243}Am and {sup 244}Cm. These isotopes were examined, and the best of gamma-ray data, including line energies and relative strengths were selected.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Soft x-ray scattering facility at the Advanced Light Source with real-time data processing and analysis

We present the development and characterization of a dedicated resonant soft x-ray scattering facility. Capable of operation over a wide energy range, the beamline and endstation are primarily used for scattering from soft matter systems around the carbon K-edge ({approx}285 eV). We describe the specialized design of the instrument and characteristics of the beamline. Operational characteristics of immediate interest to users such as polarization control, degree of higher harmonic spectral contamination, and detector noise are delineated. Of special interest is the development of a higher harmonic rejection system that improves the spectral purity of the x-ray beam. Special software and a user-friendly interface have been implemented to allow real-time data processing and preliminary data analysis simultaneous with data acquisition.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Particle learning for probabilistic deterministic finite automata

The plpdfa software is a product of an LDRD project at LLNL entitked "Adaptive Sampling for Very High Throughput Data Streams" (tracking number 11-ERD-035). This software was developed by a graduate student summer intern, Chris Challis, who worked under project PI Dan Merl furing the summer of 2011. The software the source code is implementing is a statistical analysis technique for clustering and classification of text-valued data. The method had been previously published by the PI in the open literature.

Source record↗