Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

The CMS High Level Trigger System: Experience and future development

The CMS experiment at the LHC features a two-level trigger system. Events accepted by the first level trigger, at a maximum rate of 100 kHz, are read out by the Data Acquisition system (DAQ), and subsequently assembled in memory in a farm of computers running a software high-level trigger (HLT), which selects interesting events for offline storage and analysis at a rate of order few hundred Hz. The HLT algorithms consist of sequences of offline-style reconstruction and filtering modules, executed on a farm of 0(10000) CPU cores built from commodity hardware. Experience from the operation of the HLT system in the collider run 2010/2011 is reported. The current architecture of the CMS HLT, its integration with the CMS reconstruction framework and the CMS DAQ, are discussed in the light of future development. The possible short- and medium-term evolution of the HLT software infrastructure to support extensions of the HLT computing power, and to address remaining performance and maintenance issues, are discussed.

Bauer, G.↗

Situational Awareness Geospatial Application (iSAGA)

Situational Awareness Geospatial Application (iSAGA) is a geospatial situational awareness software tool that uses an algorithm to extract location data from nearly any internet-based, or custom data source and display it geospatially; allows user-friendly conduct of spatial analysis using custom-developed tools; searches complex Geographic Information System (GIS) databases and accesses high resolution imagery. iSAGA has application at the federal, state and local levels of emergency response, consequence management, law enforcement, emergency operations and other decision makers as a tool to provide complete, visual, situational awareness using data feeds and tools selected by the individual agency or organization. Feeds may be layered and custom tools developed to uniquely suit each subscribing agency or organization. iSAGA may similarly be applied to international agencies and organizations.

Sher, Benjamin↗

GAT (Grid Analysis Toolkit) [SWR-25-41]

Grid Analysis Toolkit (GAT) is a unified Python API and plotting for power system PCM and CEM results (Sienna, PLEXOS, ReEDS™). It's a toolkit for wrangling data for Bulk Grid Dispatch and Transmission Analysis. GAT aims to provide simplified access to PCM and CEM results in a standard format while also allowing raw data access to underlying datasets specific to the model. This software can also be found on PyPI at For plotting, GAT defaults to standard National Lab of the Rockies (NLR) color schemes and standard styles while allowing customization.

Webb, Micah [National Laboratory of the Rockies (N↗

Pan-arctic river bank erosion and accretion, and planform metrics measured over intervals ranging from 1973 to 2016

This dataset provides the tabular summary of analysis of 17 reaches of 15 Arctic rivers for river bank erosion and accretion rates, as well as, river channel properties such as channel width, bank curvature, and the aspect/orientation of the river banks. These rivers include the: Chandalar River, Alaska, Colville River, Alaska; Indigirka River, Russia; Kolyma River, Russia; Koyukuk River, Alaska; Lena River, Alaska; Noatak River, Alaska; Ob River, Russia; Pechora River, Russia; Tanana River, Alaska, Selawik River, Alaska; Taz River, Russia; Yana River, Russia; Yenisei River, Russia; and the Yukon River, Alaska. The dataset was generated from a total of 129 images including: Landsat, higher resolution satellite imagery, and aerial photography over time periods ranging from the 1970s and 2016. A full list of the image dates, row and path (for Landsat), and pixel resolutions is provided in the dataset. Masks for the Chandalar River, Tanana River, and Yukon at Holy Cross were obtained from Brown et al. (2020). The masks were analyzed using the Spatially Continuous Riverbank Erosion and Accretion Measurements (SCREAM) software detailed in Rowland et al. 2016. The masks used in this analysis can be found an accompanying dataset (doi:10.15485/1571527).In files with “summary” in the name, the data is provided at a pixel level, where each mapped bank pixel has an associated erosion or accretion value, a channel width, a curvature value, and an aspect each river and time period will have an individual file. Files with “Segments” in name provide data that is averaged along segments of the rivers. These data are consolidated into a single file each for the erosion and accretion measurements. These segments are approximately 10 channel widths in length. In addition to erosion and accretion rates, the segment-based results include area measurements of erosion and accretion, islands, and channels. Revisions 2023:-Data added for the Koyukuk River for time periods of 1978-2012, 1978-2018, and 2012-2018. ---Data added from the Chandalar River, Tanana River, and Yukon River at Holy Cross based on masks obtained from Brown et al. (2020).-Updated the values for Drainage area and river slope, see methods below-Added values for meant topographic slope for upstream contributing area, long term averaged annual maximum monthly flow, average annual maximum monthly flow for the time period of erosion record, and added the river slope extracted from the Lin et al. (2020) data product.-Add field for River Planform Multi threaded (M) or Single threaded-Added ‘ConsolidatedErosionSegments.csv’ which provides the same data as AllRiversErosionSegments.csv rebinned with averages along river segments based on upstream drainage area instead of channel segments based on lengths set to approximately 10 channel widths.

54 ENVIRONMENTAL SCIENCES↗

Ocean & Geohazard Analysis Tool

The Ocean & Geohazard Analysis (OGA) software tool is designed to summarize insights into key offshore hazards drawing from a diverse set of approaches, including artificial intelligence, machine learning, probabilistic and statistical, and offshore data sources. The offshore hazards that can be analyzed include submarine landslides, extreme wind/wave/current event probabilities, earthquakes, and metocean pathways (CIAM Climatological Isolation and Attraction Model–Climatological Lagrangian Coherent Structures - Submissions - EDX (doe.gov)). Currently, the tool is developed for use in the Gulf of Mexico. The data underlying the offshore hazard analyses can be found here: https://edx.netl.doe.gov/dataset/gulf-of-mexico-risk-analysis-database-gomrad This work was conducted under the Advanced Offshore Research Portfolio, FWP Number 1022409 at National Energy Technology Laboratory, U.S. Dept. of Energy. Disclaimer This project was funded by the United States Department of Energy, National Energy Technology Laboratory, in part, through a site support contract. Neither the United States Government nor any agency thereof, nor any of their employees, nor the support contractor, nor any of their employees, makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States Government or any agency thereof. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States Government or any agency thereof.

AIML↗

Advanced Characterization: 3D chemistry and structure at sub-nm resolution

This work has started the process of extending nanometer-scale comprehensive microanalysis to the 3rd dimension by combining full x-ray spectral imaging with previously developed computed tomography techniques whereby we acquire a series of spectral images for a large number of projections of the same specimen in the transmission electron microscope and then analyze the composite computed tomographic spectral image data prior to application of existing tomographic reconstruction software. We have demonstrated a needle-shaped specimen geometry (shape/size and preparation method) by focused ion beam preparation and acquisition and analysis of a complete tomographic spectral image on a test material consisting of fine-grained Ni with sub-10 nm alumina particles.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Materials Characterization Techniques Lecture Series: X-Ray Diffraction, A Summary of LANL's Materials Capabilities in MPA-11 [Slides]

This presentation provides an overview on X-Ray Diffraction (XRD) to cover background, fundamentals, limitations, best practices, applications, analysis, software, and resources. To summarize: XRD is a great tool for characterizing solid crystalline samples. X-Rays are E-Mag radiation and generate diffraction profiles based on the phase of the sample. Diffraction patterns are unique to the phase of the sample. Powder diffraction gives us better diffraction profiles. We can obtain both qualitative and quantitative data. Analysis requires us to know a little about our sample and a lot about our diffractometer.

36 MATERIALS SCIENCE↗

Process Image Analysis using Big Data, Machine Learning, and Computer Vision

The development of algorithms for machine learning and data analysis for the 3013 MIS corrosion surveillance program is a collaborative effort by SRNL, USC and GT. For corrosion detection, LCM image data is extracted from large binary files, with software written to convert the data to physical attributes (i.e. height, color and grayscale values; all as functions of a location in a plane projection). The user interface for the software permits selective downloading of binary data and interrogation of attributes. User input thresholds are used to flag attributes of interest. Machine learning algorithms, developed for this application, are used to determine whether the features are the result of corrosion. To address the fundamental mechanisms of corrosion, machine learning algorithms are being developed to derive interatomic potential force-fields from ab-initio DFT calculations. The goal is to apply molecular modeling on a large enough scale to guide the design of resistant materials.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Investigation and Diagnosis of Faulty Data Channels in CMS Outer Tracker Module Testing

The High-Luminosity Large Hadron Collider (HL-LHC) is currently undergoing upgrades to improve its luminosity. In parallel, this requires an upgrade to the Compact Muon Solenoid (CMS)’s Outer Tracker, consisting of Pixel-Strip (PS) and Strip-Strip (2S) modules that can accurately track the path of charged particles originating from the collisions. It follows that such complex modules call for extensive testing, requiring a sophisticated Data Acquisition (DAQ) system that can perform specific tests to assess their performance. In addition, errors caused by the hardware of a given testing station, and its associated data channel, need to be accurately identified to guarantee proper testing of modules. We have developed a software extension to the Phase-II Outer Tracker Analyzer of Test Outputs (POTATO), which is a specialized software designed to analyze and grade all of the module tests through a centralized database. This extension categorizes and analyzes module test results by its station and data channel. Its analysis can be used to identify trends in grading that indicate issues in these channels’ grading process rather than in the individual modules. This poster shows our methodology and results for identifying faulty data channels. Using this extension, we can quickly diagnose and address problems in our DAQ system, ensuring proper evaluation corrections for each module.

Chen, Angus [Fermilab]↗

Investigation and Diagnosis of Faulty Data Channels in CMS Outer Tracker Module Testing

The High-Luminosity Large Hadron Collider (HL-LHC) is currently undergoing upgrades to improve its luminosity. In parallel, this requires an upgrade to the Compact Muon Solenoid (CMS)’s Outer Tracker, consisting of Pixel-Strip (PS) and Strip-Strip (2S) modules that can accurately track the path of charged particles originating from the collisions. It follows that such complex modules call for extensive testing, requiring a sophisticated Data Acquisition (DAQ) system that can perform specific tests to assess their performance. In addition, errors caused by the hardware of a given testing station, and its associated data channel, need to be accurately identified to guarantee proper testing of modules. We have developed a software extension to the Phase-II Outer Tracker Analyzer of Test Outputs (POTATO), which is a specialized software designed to analyze and grade all of the module tests through a centralized database. This extension categorizes and analyzes module test results by its station and data channel. Its analysis can be used to identify trends in grading that indicate issues in these channels’ grading process rather than in the individual modules. This poster shows our methodology and results for identifying faulty data channels. Using this extension, we can quickly diagnose and address problems in our DAQ system, ensuring proper evaluation corrections for each module.

Chen, Angus [Fermilab]↗

Synchrotron X-ray Microdiffraction and Fluorescence Imaging of Mineral and Rock Samples

In this paper, we describe a detailed procedure for acquiring and processing x-ray microfluorescence (μXRF), and Laue and powder microdiffraction two-dimensional (2D) maps at beamline 12.3.2 of the Advanced Light Source (ALS), Lawrence Berkeley National Laboratory. Measurements can be performed on any sample that is less than 10 cm x 10 cm x 5 cm, with a flat exposed surface. The experimental geometry is calibrated using standard materials (elemental standards for XRF, and crystalline samples such as Si, quartz, or Al 2 O 3 for diffraction). Samples are aligned to the focal point of the x-ray microbeam, and raster scans are performed, where each pixel of a map corresponds to one measurement, e.g. , one XRF spectrum or one diffraction pattern. The data are then processed using the in-house developed software XMAS, which outputs text files, where each row corresponds to a pixel position. Representative data from moissanite and an olive snail shell are presented to demonstrate data quality, collection, and analysis strategies.

36 MATERIALS SCIENCE↗

Holistic Transportation and Energy Modeling

This project advances the development and application of the TEMPO transportation energy systems model to support DOE analysis of evolving mobility futures. Recent work has focused on improving model transparency, performance, and fidelity through a redesigned software architecture and updated technology adoption scenarios aligned with the latest data and assumptions. Ongoing efforts aim to expand TEMPO's ability to assess transportation affordability and consumer decision-making, including vehicle ownership dynamics and distributional impacts across households. These enhancements position TEMPO to better inform policy and R&D decisions by providing more behaviorally realistic and policy-relevant insights into transportation energy use, technology adoption, and system-level outcomes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Geothermal play fairway analysis, part 1: Example from the Snake River Plain, Idaho

The Snake River Plain (SRP) volcanic province overlies the track of the Yellowstone hotspot, a thermal anomaly that extends deep into the mantle. Most of the area is underlain by a basaltic volcanic province that overlies a mid-crustal intrusive complex, which in turn provides the long-term heat flux needed to sustain geothermal systems. Previous studies have identified several known geothermal resource areas within the SRP. For the geothermal study presented herein, our goals were to: (1) adapt the methodology of Play Fairway Analysis (PFA) for geothermal exploration to create a formal basis for its application to geothermal systems, (2) assemble relevant data for the SRP from publicly available and private sources, and (3) build a geothermal PFA model for the SRP and identify the most promising plays, using GIS-based software tools that are standard in the petroleum industry. The study focused on identifying three critical resource parameters for exploitable hydrothermal systems in the SRP: heat source, reservoir and recharge permeability, and cap or seal. Data included in the compilation for heat source were heat flow, distribution and ages of volcanic vents, groundwater temperatures, thermal springs and wells, helium isotope anomalies, and reservoir temperatures estimated using geothermometry. Reservoir and recharge permeability was inferred from the analysis of stress orientations and magnitudes, post-Miocene faults, and subsurface structural lineaments based on magnetics and gravity data. Data for cap or seal included the distribution of impermeable lake sediments and clay-seal associated with hydrothermal alteration below the regional aquifer. These data were used to compile Common Risk Segment maps for heat, permeability, and seal, which were combined to create a Composite Common Risk Segment map for all southern Idaho that reflects the risk associated with geothermal resource exploration and identifies favorable resource tracks. Our regional assessment indicated that undiscovered geothermal resources may be located in several areas of the SRP. Two of these areas, the western SRP and Camas Prairie, were selected for more detailed assessment, during which heat, permeability, and seal were evaluated using newly collected field data and smaller grid parameters to refine the location of potential resources. These higher resolution assessments illustrate the flexibility of our approach over a range of scales.

54 ENVIRONMENTAL SCIENCES↗

Advances, Interactions, and Future Developments in the CNS, Phenix, and Rosetta Structural Biology Software Systems; For Annual Review of Biophysics

Advances in our understanding of macromolecular structure come from experimental methods, such as X-ray crystallography, and also computational analysis of the growing number of atomic models obtained from such experiments. The later analyses have made it possible to develop powerful tools for structure prediction and optimization in the absence of experimental data. In recent years a synergy between these computational methods for crystallographic structure determination and structure prediction and optimization has begun to be exploited. We review some of the advances in the algorithms used for crystallographic structure determination in the Phenix and Crystallography & NMR System software packages, and describe how methods from ab initio structure prediction and refinement in Rosetta have been applied to challenging crystallographic problems. The prospects for future improvement of these methods are discussed.

Basic Biological Sciences(59)↗

A data analysis method to rapidly characterize gallium concentration in plutonium matrices using LIBS

The processing of actinide samples is a complex and costly endeavor that requires compositional analysis at various stages. Laser-induced breakdown spectroscopy (LIBS) has been used to analyze actinide-containing samples in many nuclear applications including waste management, fuel processing and forensics. The LIBS spectrum obtained from actinide materials are generally extremely complex, exhibiting many thousands of strong emission lines. This makes it difficult to identify other elements within the sample of interest, given the rich and dominant actinide spectrum. Here, in this article, we describe a recent effort to identify and quantify impurities and alloying constituents in plutonium matrices using a hand-held LIBS instrument that is used to rapidly and efficiently measure an emission spectrum from a material sample. We tabulate the emission line positions and intensities of plutonium. We report the development of machine-learning software that can identify gallium and quantify its concentration in plutonium matrices. This work has the potential to provide a rapid and nearly non-destructive technique that allows more confidence in characterizing the composition of materials that are present within complex actinide associated targets. We describe how our LIBS measurements and data analysis methods have successfully quantified the gallium concentration in a variety of samples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Rapid QSTS Simulations for High-Resolution Comprehensive Assessment of Distributed PV

The rapid increase in penetration of distributed energy resources on the electric power distribution system has created a need for more comprehensive interconnection modeling and impact analysis. Unlike conventional scenario-based studies, quasi-static time-series (QSTS) simulations can realistically model time-dependent voltage controllers and the diversity of potential impacts that can occur at different times of year. However, to accurately model a distribution system with all its controllable devices, a yearlong simulation at 1-second resolution is often required, which could take conventional computers a computational time of 10 to 120 hours when an actual unbalanced distribution feeder is modeled. This computational burden is a clear limitation to the adoption of QSTS simulations in interconnection studies and for determining optimal control solutions for utility operations. The solutions we developed include accurate and computationally efficient QSTS methods that could be implemented in existing open-source and commercial software used by utilities and the development of methods to create high-resolution proxy data sets. This project demonstrated multiple pathways for speeding up the QSTS computation using new and innovative methods for advanced time-series analysis, faster power flow solvers, parallel processing of power flow solutions and circuit reduction. The target performance level for this project was achieved with year-long high-resolution time series solutions run in less than 5 minutes within an acceptable error.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Symmetry-mode analysis for local structure investigations using pair distribution function data

Symmetry-adapted distortion modes provide a natural way of describing distorted structures derived from higher-symmetry parent phases. Structural refinements using symmetry-mode amplitudes as fit variables have been used for at least ten years in Rietveld refinements of the average crystal structure from diffraction data; more recently, this approach has also been used for investigations of the local structure using real-space pair distribution function (PDF) data. Here, the value of performing symmetry-mode fits to PDF data is further demonstrated through the successful application of this method to two topical materials: TiSe2, where a subtle but long-range structural distortion driven by the formation of a charge-density wave is detected, and MnTe, where a large but highly localized structural distortion is characterized in terms of symmetry-lowering displacements of the Te atoms. Here, the analysis is performed using fully open-source code within the DiffPy framework via two packages developed for this work: isopydistort, which provides a scriptable interface to the ISODISTORT web application for group theoretical calculations, and isopytools, which converts the ISODISTORT output into a DiffPy-compatible format for subsequent fitting and analysis. These developments expand the potential impact of symmetry-adapted PDF analysis by enabling high-throughput analysis and removing the need for any commercial software.

36 MATERIALS SCIENCE↗

NEW TECHNIQUES FOR HIGH-CONTRAST IMAGING WITH ADI: THE ACORNS-ADI SEEDS DATA REDUCTION PIPELINE

We describe Algorithms for Calibration, Optimized Registration, and Nulling the Star in Angular Differential Imaging (ACORNS-ADI), a new, parallelized software package to reduce high-contrast imaging data, and its application to data from the SEEDS survey. We implement several new algorithms, including a method to register saturated images, a trimmed mean for combining an image sequence that reduces noise by up to {approx}20%, and a robust and computationally fast method to compute the sensitivity of a high-contrast observation everywhere on the field of view without introducing artificial sources. We also include a description of image processing steps to remove electronic artifacts specific to Hawaii2-RG detectors like the one used for SEEDS, and a detailed analysis of the Locally Optimized Combination of Images (LOCI) algorithm commonly used to reduce high-contrast imaging data. ACORNS-ADI is written in python. It is efficient and open-source, and includes several optional features which may improve performance on data from other instruments. ACORNS-ADI requires minimal modification to reduce data from instruments other than HiCIAO. It is freely available for download at www.github.com/t-brandt/acorns-adi under a Berkeley Software Distribution (BSD) license.

79 ASTRONOMY AND ASTROPHYSICS↗