Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS1975

Low-cost data analysis systems for processing multispectral scanner data

A research-oriented data analysis system was developed which is used for evaluating complex remote sensor systems and for development of techniques for application of remotely sensed data. Some modular hardware components were developed which may be added to one's existing facilities to establish a low-cost data analysis system for processing multispectral scanner data. Software modules which are compatible with small general purpose digital computers process and analyze remote sensor data, and convert it to information needed by users. The software modules are written in FORTRAN IV language for ease of transfer to other computer systems. The basic hardware and software system requirements are defined for some low-cost data analysis systems consisting of an image display system, a small general purpose digital computer, and an output recording device. The hardware modules consist of: a LANDSAT MSS data reformatting program; a series of spectral pattern recognition programs required to generate surface classification maps and tabular information; programs to convert computer generated maps from image space to a geographically referenced base; programs to extract data and irregularly shaped areas and to produce thematic maps of the designated areas; and programs to tabulate acreages of selected classification categories. Some off-the-shelf, inexpensive digital image display systems are described.

Whitley, S. L.↗
NASA NTRS2002

Software for Statistical Analysis of Weibull Distributions with Application to Gear Fatigue Data: User Manual with Verification

The Weibull distribution has been widely adopted for the statistical description and inference of fatigue data. This document provides user instructions, examples, and verification for software to analyze gear fatigue test data. The software was developed presuming the data are adequately modeled using a two-parameter Weibull distribution. The calculations are based on likelihood methods, and the approach taken is valid for data that include type 1 censoring. The software was verified by reproducing results published by others.

Krantz, Timothy L.↗
NASA NTRS2002

Software for Statistical Analysis of Weibull Distributions with Application to Gear Fatigue Data: User Manual with Verification

The Weibull distribution has been widely adopted for the statistical description and inference of fatigue data. This document provides user instructions, examples, and verification for software to analyze gear fatigue test data. The software was developed presuming the data are adequately modeled using a two-parameter Weibull distribution. The calculations are based on likelihood methods, and the approach taken is valid for data that include type I censoring. The software was verified by reproducing results published by others.

Kranz, Timothy L.↗
NASA NTRS1992

The FAST Hipparcos data reduction consortium - Overview of the reduction software

The main features of the data analysis methods adopted by FAST in the calibration and processing of the Hipparcos data are discussed. The structure of the data reduction software is examined, and the actual processing and evaluation are presented. Attention is given to the first look task, the calibration task, data preparation, attitude determination, the great circle reduction, synthesis treatment, iterations, data management and command software, and follow-up and evaluation activities.

Kovalevsky, J.↗
NASA NTRS2007

General-Purpose Front End for Real-Time Data Processing

FRONTIER is a computer program that functions as a front end for any of a variety of other software of both the artificial intelligence (AI) and conventional data-processing types. As used here, front end signifies interface software needed for acquiring and preprocessing data and making the data available for analysis by the other software. FRONTIER is reusable in that it can be rapidly tailored to any such other software with minimum effort. Each component of FRONTIER is programmable and is executed in an embedded virtual machine. Each component can be reconfigured during execution. The virtual-machine implementation making FRONTIER independent of the type of computing hardware on which it is executed.

James, Mark↗
DOE OSTI2021

Scalable Comparative Visualization of Ensembles of Call Graphs

Optimizing the performance of large-scale parallel codes is critical for efficient utilization of computing resources. Code developers often explore various execution parameters, such as hardware configurations, system software choices, and application parameters, and are interested in detecting and understanding bottlenecks in different executions. They often collect hierarchical performance profiles represented as call graphs, which combine performance metrics with their execution contexts. The crucial task of exploring multiple call graphs together is tedious and challenging because of the many structural differences in the execution contexts and significant variability in the collected performance metrics (e.g., execution runtime). In this paper, we present Ensemble CallFlow to support the exploration of ensembles of call graphs using new types of visualizations, analysis, graph operations, and features. We introduce ensemble-Sankey , a new visual design that combines the strengths of resource-flow (Sankey) and box-plot visualization techniques. Whereas the resource-flow visualization can easily and intuitively describe the graphical nature of the call graph, the box plots overlaid on the nodes of Sankey convey the performance variability within the ensemble. Our interactive visual interface provides linked views to help explore ensembles of call graphs, e.g., by facilitating the analysis of structural differences, and identifying similar or distinct call graphs. Finally, we demonstrate the effectiveness and usefulness of our design through case studies on large-scale parallel codes.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1991

Monte Carlo Shower Counter Studies

Activities and accomplishments related to the Monte Carlo shower counter studies are summarized. A tape of the VMS version of the GEANT software was obtained and installed on the central computer at Gallaudet University. Due to difficulties encountered in updating this VMS version, a decision was made to switch to the UNIX version of the package. This version was installed and used to generate the set of data files currently accessed by various analysis programs. The GEANT software was used to write files of data for positron and proton showers. Showers were simulated for a detector consisting of 50 alternating layers of lead and scintillator. Each file consisted of 1000 events at each of the following energies: 0.1, 0.5, 2.0, 10, 44, and 200 GeV. Data analysis activities related to clustering, chi square, and likelihood analyses are summarized. Source code for the GEANT user subprograms and data analysis programs are provided along with example data plots.

Snyder, H. David↗
NASA NTRS1980

Evaluation of SLAR and thematic mapper MSS data for forest cover mapping using computer-aided analysis techniques

The column normalizing technique was used to adjust the data for variations in the amplitude of the signal due to look angle effects with respect to solar zenith angle along the scan lines (i.e., across columns). Evaluation of the data set containing the geometric and radiometric adjustments, indicates that the data set should be satisfactory for further processing and analysis. Software was developed for degrading the spatial resolution of the aircraft data to produce a total of four data sets for further analysis. The quality of LANDSAT 2 CCT data for the test site is good for channels four, five, and six. Channel seven was not present on the tape. The data received were reformatted and analysis of the test site area was initiated.

Hoffer, R. M.↗
DOE OSTI2021

py4DSTEM: A Software Package for Four-Dimensional Scanning Transmission Electron Microscopy Data Analysis

Scanning transmission electron microscopy (STEM) allows for imaging, diffraction, and spectroscopy of materials on length scales ranging from microns to atoms. By using a high-speed, direct electron detector, it is now possible to record a full two-dimensional (2D) image of the diffracted electron beam at each probe position, typically a 2D grid of probe positions. These 4D-STEM datasets are rich in information, including signatures of the local structure, orientation, deformation, electromagnetic fields, and other sample-dependent properties. However, extracting this information requires complex analysis pipelines that include data wrangling, calibration, analysis, and visualization, all while maintaining robustness against imaging distortions and artifacts. In this paper, we present py4DSTEM, an analysis toolkit for measuring material properties from 4D-STEM datasets, written in the Python language and released with an open-source license. We describe the algorithmic steps for dataset calibration and various 4D-STEM property measurements in detail and present results from several experimental datasets. We also implement a simple and universal file format appropriate for electron microscopy data in py4DSTEM, which uses the open-source HDF5 standard. We hope this tool will benefit the research community and help improve the standards for data and computational methods in electron microscopy, and we invite the community to contribute to this ongoing project.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Data from: Lowland Tropical Forests Remain a Methane Sink Under Warming and Long-Term Hurricane Disturbance Recovery

The repository folder contains spreadsheets and script for soil greenhouse gas (GHG) fluxes, soil moisture, soil temperature, air temperature, and precipitation measurements collected from the Tropical Responses to Altered Climate Experiment (TRACE) at the Sabana Research Field Station, El Yunque National Forest (USDA Forest Service; 18°19′28.74″ N, 65°43′50.09″ W) — an open-air field warming experiment located in a lowland tropical forest in Puerto Rico within the Luquillo Experimental Forest (LEF) — six to seven years after Hurricanes Irma and Maria (2017). All spreadsheets for soil and air microclimate data, as well as soil greenhouse gas data, are included as csv files. Air temperature data are also included as Excel spreadsheets (.xlsx). The script is built in R Studio, which is the only software required to run data analysis. This dataset is associated with the manuscript “Larocca Conte G ; Zuvela L ; Cruz-Pérez R ; Barreto-Vélez T ; Becerra-Santillan N ; Campbell S ; Chu H ; Dam T ; Grullón-Penkova I ; Kleit M ; Ortiz-Iglesias D ; Rubio-Lebrón L ; Cavaleri M ; Reed S ; Sihi D ; Wood T ; O'Connell C., 2026. Lowland Tropical Forests Remain a Methane Sink Under Warming and Long-Term Hurricane Disturbance Recovery. Agricultural and Forest Meteorology. In review". The dataset was used to test the effect of warming on soil CH4 dynamics following long-term legacy effects of hurricane disturbance. The dataset includes: - An overall README file in word and pdf format describing methodology and spreadsheets’ structure. - Continuous measurements of soil temperature and moisture from January 2023 to July 2024 measured with Campbell CS655 probes (“TRACE_soil_temperature_and_moisture_2023_cleaned(in).csv” and “TRACE_soil_temperature_and_moisture_2024_cleaned. csv”). - Air temperature data measured with a HOBO MX23O1A data logger (“Hobo air temperature 2023 Sep 2024” and “Hobo air temperature 2023 Sep 2024” – “CSV FILES folders”). - Precipitation data from a nearby weather tower downloaded from González et al. (2025; “sabana_2020-2025.csv”). - Soil CH4 and CO2 effluxes measured intermittently in two summer campaigns (June – August 2023 and June – July 2024) with a LI-COR 8200-01S Portable Smart Chamber coupled with a LI-COR LI-7810 CH4/ CO2/H2O Trace Gas Analyzer (“23_24COMBO2.0.csv”). - R markdown script for data analysis (“Trace new_PLOTS.Rmd”).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Archetype-based Redshift Estimation for the Dark Energy Spectroscopic Instrument Survey

We present a computationally efficient galaxy archetype-based redshift estimation and spectral classification method for the Dark Energy Survey Instrument (DESI) survey. The DESI survey currently relies on a redshift fitter and spectral classifier using a linear combination of principal component analysis–derived templates, which is very efficient in processing large volumes of DESI spectra within a short time frame. However, this method occasionally yields unphysical model fits for galaxies and fails to adequately absorb calibration errors that may still be occasionally visible in the reduced spectra. Our proposed approach improves upon this existing method by refitting the spectra with carefully generated physical galaxy archetypes combined with additional terms designed to absorb data reduction defects and provide more physical models to the DESI spectra. We test our method on an extensive data set derived from the survey validation (SV) and Year 1 (Y1) data of DESI. Our findings indicate that the new method delivers marginally better redshift success for SV tiles while reducing catastrophic redshift failure by 10%–30%. At the same time, results from millions of targets from the main survey show that our model has relatively higher redshift success and purity rates (0.5%–0.8% higher) for galaxy targets while having similar success for QSOs. These improvements also demonstrate that the main DESI redshift pipeline is generally robust. Additionally, it reduces the false-positive redshift estimation by 5%–40% for sky fibers. We also discuss the generic nature of our method and how it can be extended to other large spectroscopic surveys, along with possible future improvements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package

The Astropy Project supports and fosters the development of open-source and openly developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package astropy, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as of the recent major release, version 5.0, and provide major updates on the Project. We then discuss supporting a broader ecosystem of interoperable packages, including connections with several astronomical observatories and missions. We also revisit the future outlook of the Astropy Project and the current status of Learn Astropy. We conclude by raising and discussing the current and future challenges facing the Project.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Considerations for Optimizing the Photometric Classification of Supernovae from the Rubin Observatory

The Vera C. Rubin Observatory will increase the number of observed supernovae (SNe) by an order of magnitude; however, it is impossible to spectroscopically confirm the class for all SNe discovered. Thus, photometric classification is crucial, but its accuracy depends on the not-yet-finalized observing strategy of Rubin Observatory's Legacy Survey of Space and Time (LSST). We quantitatively analyze the impact of the LSST observing strategy on SNe classification using simulated multiband light curves from the Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC). First, we augment the simulated training set to be representative of the photometric redshift distribution per SNe class, the cadence of observations, and the flux uncertainty distribution of the test set. Then we build a classifier using the photometric transient classification library snmachine, based on wavelet features obtained from Gaussian process fits, yielding a similar performance to the winning PLAsTiCC entry. We study the classification performance for SNe with different properties within a single simulated observing strategy. We find that season length is important, with light curves of 150 days yielding the highest performance. Cadence also has an important impact on SNe classification; events with median inter-night gap <3.5 days yield higher classification performance. Interestingly, we find that large gaps (>10 days) in light-curve observations do not impact performance if sufficient observations are available on either side, due to the effectiveness of the Gaussian process interpolation. This analysis is the first exploration of the impact of observing strategy on photometric SN classification with LSST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Impact of Rubin Observatory Cadence Choices on Supernovae Photometric Classification

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will discover an unprecedented number of supernovae (SNe), making spectroscopic classification for all the events infeasible. LSST will thus rely on photometric classification, whose accuracy depends on the not-yet-finalized LSST observing strategy. In this work, we analyze the impact of cadence choices on classification performance using simulated multiband light curves. First, we simulate SNe with an LSST baseline cadence, a nonrolling cadence, and a presto-color cadence, which observes each sky location three times per night instead of twice. Each simulated data set includes a spectroscopically confirmed training set, which we augment to be representative of the test set as part of the classification pipeline. Then we use the photometric transient classification library snmachine to build classifiers. We find that the active region of the rolling cadence used in the baseline observing strategy yields a 25% improvement in classification performance relative to the background region. This improvement in performance in the actively rolling region is also associated with an increase of up to a factor of 2.7 in the number of cosmologically useful Type Ia SNe relative to the background region. However, adding a third visit per night as implemented in presto-color degrades classification performance due to more irregularly sampled light curves. Overall, our results establish desiderata on the observing cadence related to classification of full SNe light curves, which in turn impacts photometric SNe cosmology with LSST.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1975

A brief review of digital image processing

The review is presented with particular reference to Skylab S-192 and Landsat MSS imagery. Attention is given to rectification (calibration) processing with emphasis on geometric correction of image distortions. Image enhancement techniques (e.g., the use of high pass digital filters to eliminate gross shading to allow emphasis of the fine detail) are described along with data analysis and system considerations (software philosophy).

Billingsley, F. C.↗
NASA NTRS1983

Development of a statewide Landsat digital data base for forest insect damage assessment

A Joint Research Project (JRP) invlving NASA/Goddard Space Flight Center and the Pennsylvania Bureau of Forestry/Division of Forest Pest Management demonstrates the utility of Landsat data for assessing forest insect damage. A major effort within the project has been the creation of map-registered, statewide Landsat digital data base for Pennsylvania. The data base, developed and stored on computers at the Pennsylvania State University Computation Center, contains Landsat imagery, a Landsat-derived forest resource map, and digitized data layers depicting Forest Pest Management District boundaries and county boundaries. A data management front-end system was also developed to provide an interface between the various layers of information within the data base and image analysis software. This front-end system insures than an automated assessment of defoliation damage can be conducted and summarized by geographic area or jurisdiction of interest.

Williams, D. L.↗
NASA NTRS1990

Frequency response of electrochemical cells

The main objective was to examine the feasibility of using frequency response techniques (1) as a tool in destructive physical analysis of batteries, particularly for estimating electrode structural parameters such as specific area, porosity, and tortuosity and (2) as a non-destructive testing technique for obtaining information such as state of charge and acceptability for space flight. The phenomena that contribute to the frequency response of an electrode include: (1) double layer capacitance; (2) Faradaic reaction resistance; (3) mass transfer of Warburg impedance; and (4) ohmic solution resistance. Nickel cadmium cells were investigated in solutions of KOH. A significant amount of data was acquired. Quantitative data analysis, using the developed software, is planned for the future.

Thomas, Daniel L.↗