Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “small files”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Radiometric Calibration and Stability of the Landsat-8 Operational Land Imager (OLI)

Landsat-8 and its two Earth imaging sensors, the Operational Land Imager (OLI) and Thermal Infrared Sensor (TIRS) have been operating on-orbit for 2 1/2 years. The OLI radiometric calibration, which is monitored using on-board lamps, on-board solar diffusers, the moon and vicarious calibration techniques has been stable to within 1% over this period of time. The Coastal Aerosol band, band 1, shows the largest change at about 1% over the period; all other bands have shown no significant trend. OLI bands 1- 4 show small discontinuities in response (+0.1% to 0.2%) beginning about 7 months after launch and continuing for about 1 month associated with a power cycling of the instrument, though the origin of the recovery is unclear. To date these small changes have not been compensated for, but this will change with a reprocessing campaign that is currently scheduled for Fall 2015. The calibration parameter files (each typically covering a 3 month period) will be updated for these observed gain changes. A fitted response to an adjusted average of the lamps, solar and lunar results will represent the trend, sampled at the rate of one value per CPF.

radiometric stability↗

Radiometric Calibration and Stability of the Landsat-8 Operational Land Imager (OLI)

Landsat-8 and its two Earth imaging sensors, the Operational Land Imager (OLI) and Thermal Infrared Sensor (TIRS) have been operating on-orbit for 2 1/2 years. The OLI radiometric calibration, which is monitored using on-board lamps, on-board solar diffusers, the moon and vicarious calibration techniques has been stable to within 1% over this period of time. The Coastal Aerosol band, band 1, shows the largest change at about 1% over the period; all other bands have shown no significant trend. OLI bands 1- 4 show small discontinuities in response (+0.1% to 0.2%) beginning about 7 months after launch and continuing for about 1 month associated with a power cycling of the instrument, though the origin of the recovery is unclear. To date these small changes have not been compensated for, but this will change with a reprocessing campaign that is currently scheduled for Fall 2015. The calibration parameter files (each typically covering a 3 month period) will be updated for these observed gain changes. A fitted response to an adjusted average of the lamps, solar and lunar results will represent the trend, sampled at the rate of one value per CPF.

radiometry↗

Open Science in Action: The Role of SWxSOC in Expedited Data Release and Cloud-based Data Processing for Heliophysics Missions

NASA's Space Weather Science Operations Center (SWxSOC) is an effort to develop a multi-mission Science Operations Center for the community and specifically Space Weather missions that require data products to be released consistently and quickly. The SWxSOC is committed to Open Science in its approach to software development and data product releases. We are currently supporting the Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) that will fly on the Lunar Gateway and the PADRE Small Sat mission. SWxSOC has established an open-source, reusable solution for transitioning data management from on-premises to the cloud, processing data files, and setting up a cloud-based analysis environment to monitor instrument anomalies. Leveraging Amazon Web Services (AWS) and making open-source tools available on GitHub, HERMES exemplifies NASA's commitment to open-source standardization, showcasing the real-world effectiveness of cloud technology in data processing, analysis, and observability. This enhances current operations and ensures faster, standardized deployments for future missions.

hermes↗

Support Routines for In Situ Image Processing

This software consists of a set of application programs that support ground-based image processing for in situ missions. These programs represent a collection of utility routines that perform miscellaneous functions in the context of the ground data system. Each one fulfills some specific need as determined via operational experience. The most unique aspect to these programs is that they are integrated into the large, in situ image processing system via the PIG (Planetary Image Geometry) library. They work directly with space in situ data, understanding the appropriate image meta-data fields and updating them properly. The programs themselves are completely multimission; all mission dependencies are handled by PIG. This suite of programs consists of: (1)marscahv: Generates a linearized, epi-polar aligned image given a stereo pair of images. These images are optimized for 1-D stereo correlations, (2) marscheckcm: Compares the camera model in an image label with one derived via kinematics modeling on the ground, (3) marschkovl: Checks the overlaps between a list of images in order to determine which might be stereo pairs. This is useful for non-traditional stereo images like long-baseline or those from an articulating arm camera, (4) marscoordtrans: Translates mosaic coordinates from one form into another, (5) marsdispcompare: Checks a Left Right stereo disparity image against a Right Left disparity image to ensure they are consistent with each other, (6) marsdispwarp: Takes one image of a stereo pair and warps it through a disparity map to create a synthetic opposite- eye image. For example, a right eye image could be transformed to look like it was taken from the left eye via this program, (7) marsfidfinder: Finds fiducial markers in an image by projecting their approximate location and then using correlation to locate the markers to subpixel accuracy. These fiducial markets are small targets attached to the spacecraft surface. This helps verify, or improve, the pointing of in situ cameras, (8) marsinvrange: Inverse of marsrange . given a range file, re-computes an XYZ file that closely matches the original. . marsproj: Projects an XYZ coordinate through the camera model, and reports the line/sample coordinates of the point in the image, (9) marsprojfid: Given the output of marsfidfinder, projects the XYZ locations and compares them to the found locations, creating a report showing the fiducial errors in each image. marsrad: Radiometrically corrects an image, (10) marsrelabel: Updates coordinate system or camera model labels in an image, (11) marstiexyz: Given a stereo pair, allows the user to interactively pick a point in each image and reports the XYZ value corresponding to that pair of locations. marsunmosaic: Extracts a single frame from a mosaic, which will be created such that it could have been an input to the original mosaic. Useful for creating simulated input frames using different camera models than the original mosaic used, and (12) merinverter: Uses an inverse lookup table to convert 8-bit telemetered data to its 12-bit original form. Can be used in other missions despite the name.

Deen, Robert G.↗

In Situ Surface Characterization

Operation of in situ space assets, such as rovers and landers, requires operators to acquire a thorough understanding of the environment surrounding the spacecraft. The following programs help with that understanding by providing higher-level information characterizing the surface, which is not immediately obvious by just looking at the XYZ terrain data. This software suite covers three primary programs: marsuvw, marsrough, and marsslope, and two secondary programs, which together use XYZ data derived from in situ stereo imagery to characterize the surface by determining surface normal, surface roughness, and various aspects of local slope, respectively. These programs all use the Planetary Image Geometry (PIG) library to read mission-specific data files. The programs themselves are completely multimission; all mission dependencies are handled by PIG. The input data consists of images containing XYZ locations as derived by, e.g., marsxyz. The marsuvw program determines surface normals from XYZ data by gathering XYZ points from an area around each pixel and fitting a plane to those points. Outliers are rejected, and various consistency checks are applied. The result shows the orientation of the local surface at each point as a unit vector. The program can be run in two modes: standard, which is typically used for in situ arm work, and slope, which is typically used for rover mobility. The difference is primarily due to optimizations necessary for the larger patch sizes in the slope case. The marsrough program determines surface roughness in a small area around each pixel, which is defined as the maximum peak-to-peak deviation from the plane perpendicular to the surface normal at that pixel. The marsslope program takes a surface normal file as input and derives one of several slope-like outputs from it. The outputs include slope, slope rover direction (a measure of slope radially away from the rover), slope heading, slope magnitude, northerly tilt, and solar energy (compares the slope with the Sun s location at local noon). The marsuvwproj program projects a surface normal onto an arbitrary plane in space, resulting in a normalized 3D vector, which is constrained to lie in the plane. The marsuvwrot program rotates the vectors in a surface normal file, generating a new surface normal file. It also can change coordinate systems for an existing surface normal file. While the algorithms behind this suite are not particularly unique, what makes the programs useful is their integration into the larger in situ image processing system via the PIG library. They work directly with space in situ data, understanding the appropriate image metadata fields and updating them properly. The secondary programs (marsuvwproj, marsuvwrot) were originally developed to deal with anomalous situations on Opportunity and Spirit, respectively, but may have more general applicability.

Deen, Robert G.↗

Parallel Performance Characterization of Columbia

Using a collection of benchmark problems of increasing levels of realism and computational effort, we will characterize the strengths and limitations of the 10,240 processor Columbia system to deliver supercomputing value to application scientists. Scientists need to be able to determine if and how they can utilize Columbia to carry extreme workloads, either in terms of ultra-large applications that cannot be run otherwise (capability), or in terms of very large ensembles of medium-scale applications to populate response matrices (capacity). We select existing application benchmarks that scale from a small number of processors to the entire machine, and that highlight different issues in running supercomputing-calss applicaions, such as the various types of memory access, file I/O, inter- and intra-node communications and parallelization paradigms. http://www.nas.nasa.gov/Software/NPB/

Biswas, Rupak↗

Portable Electromyograph

A portable electronic apparatus records electromyographic (EMG) signals in as many as 16 channels at a sampling rate of 1,024 Hz in each channel. The apparatus (see figure) includes 16 differential EMG electrodes (each electrode corresponding to one channel) with cables and attachment hardware, reference electrodes, an input/output-and-power-adapter unit, a 16-bit analog-to-digital converter, and a hand-held computer that contains a removable 256-MB flash memory card. When all 16 EMG electrodes are in use, full-bandwidth data can be recorded in each channel for as long as 8 hours. The apparatus is powered by a battery and is small enough that it can be carried in a waist pouch. The computer is equipped with a small screen that can be used to display the incoming signals on each channel. Amplitude and time adjustments of this display can be made easily by use of touch buttons on the screen. The user can also set up a data-acquisition schedule to conform to experimental protocols or to manage battery energy and memory efficiently. Once the EMG data have been recorded, the flash memory card is removed from the EMG apparatus and placed in a flash-memory- card-reading external drive unit connected to a personal computer (PC). The PC can then read the data recorded in the 16 channels. Preferably, before further analysis, the data should be stored in the hard drive of the PC. The data files are opened and viewed on the PC by use of special- purpose software. The software for operation of the apparatus resides in a random-access memory (RAM), with backup power supplied by a small internal lithium cell. A backup copy of this software resides on the flash memory card. In the event of loss of both main and backup battery power and consequent loss of this software, the backup copy can be used to restore the RAM copy after power has been restored. Accessories for this device are also available. These include goniometers, accelerometers, foot switches, and force gauges.

De Luca, Gianluca↗

CFDP Performance over Weather-Dependent Ka-Band Channel

This study presents an analysis of the delay performance of the CCSDS File Delivery Protocol (CFDP) over weather-dependent Ka-band channel. The Ka-band channel condition is determined by the strength of the atmospheric noise temperature, which is weather dependent. Noise temperature data collected from the Deep Space Network (DSN) Madrid site is used to characterize the correlations between good and bad channel states in a two-state Markov model. Specifically, the probability distribution of file delivery latency using the CFDP deferred Negative Acknowledgement (NAK) mode is derived and quantified. Deep space communication scenarios with different file sizes and bit error rates (BERs) are studied and compared. Furthermore, we also examine the sensitivity of our analysis with respect to different data sampling methods. Our analysis shows that while the weather-dependent channel only results in fairly small increases in the average number of CFDP retransmissions required, the maximum number of transmissions required to complete 99 percentile, on the other hand, is significantly larger for the weather-dependent channel due to the significant correlation of poor weather states.

weather↗

Investigation of Skylab imagery for regional planning

The author has identified the following significant results. It is feasible to use earth terrain camera imagery to detect four land uses (vacant land, developed land, streets, and water) for general regional planning purposes. Multispectral imagery is suitable for detecting, mapping, and measuring water bodies as small as two acres. Sufficient information can be extracted to prepare graphic and pictorial representations of the general growth and development patterns, but cannot be incorporated into an inventory file for predictive models.

Harting, W.↗

Interdisciplinary Research Scenario Testing of EOSDIS

During the reporting period, the Principle Investigator (PI) has continued to serve on numerous review panels, task forces and committees with the goal of providing input and guidance for the Earth Observing System Data and Information System (EOSDIS) program at NASA Headquarters and NASA GSFC. In addition, the PI has worked together with personnel at the University of Virginia and the subcontractor (Simpson Weather Associates (SWA)) to continue to evaluate the latest releases of various versions of the user interfaces to the EOSDIS. Finally, as part of the subcontract, SWA has created an on-line Hierarchial Data Format (HDF) tutorial for non-HDF experts, particularly those that will be using EOSDIS and future EOS data products. A summary of these three activities is provided. The topics include: 1) Participation on EODIS Panels and Committees; 2) Evaluation and Tire Kicking of EODIS User Interfaces; and 3) An On-line HDF Tutorial. The report also includes attachments A, B, and C. Attachment A: Report From the May 1999 Science Data Panel. The topics include: 1) Summary of Data Panel Meeting; and 2) Panel's Comments/Recommendations. Attachment B: Survey Requesting Integrated Design Systems (IDS) Teams Input on the Descoping and Rescoping of the EODIS; and Attachment C: An HDF Tutorial for Beginners: EODIS Users and Small Data Providers (HTML Version). The topics include: 1) Tutorial Overview; 2) An introduction to HDF; 3) The HDF Library: Software and Hardware; 4) Methods of Working with HDF Files; 5) Scientific Data API; 6) Attributes and Metadata; 7) Writing a SDS to an HDF file; 8) Obtaining Information on Existing HDF Files; 9) Reading a Scientific Data Set from an HDF file: 10) Example Programs; 11) Browsing and Visualizing HDF Data; and 12) Laboratory (Question and Answer).

Emmitt, G. D.↗

BOREAS RSS-2 Extracted Reflectance Factors Derived from ASAS Imagery

The BOREAS RSS-2 team derived atmospherically corrected bidirectional reflectance factor means from multispectral, multiangle ASAS imagery for small homogeneous areas near several BOREAS sites. The ASAS imagery was acquired from the C-130 aircraft platform in 1994 and 1996. The data are stored in tabular ASCII files.

Russell, C.↗

Applications of remote-sensing data in Alaska

Public and private agencies were introduced to the use of remotely sensed data obtained by both satellite and aircraft, and benefitted from facilities for data processing enhancement and interpretation as well as from the institute's data library. Cooperative ventures involving the performance of operational activities included assistance to the Bureau of Land Management in the suppression of wildfires; the selection of sites for power line right-of-way; the mapping of leads in sea ice; determination of portions of public lands to be allocated for small scale farming; the identification of areas for large scale farming of barley; the observation of coastal processes and sediment transport near Prudhoe Bay; the establishment of a colar infrared file of the entire state; and photomapping for geological surveys. Monitoring of the outer continental shelf environment and reindeer herds was also conducted. Institutional constraints to full utilization of satellite remote sensing in the state are explored and plans for future activites include the generation of awareness by government agencies, the training of state personnel, and improving coordination and communication with users.

Miller, J. M.↗

Approach and landing simulator for Space Shuttle Orbiter touchdown conditions

This study describes a computer simulation that provides an accurate calculation of the touchdown conditions. The program is small enough to operate on a personal computer. The program simulates the Orbiter trajectory from an altitude of 10,000 ft to the earth's surface. It assumes the Orbiter files close to its reference altitude profile, with negligible crosswind effects. Flight data have proven both assumption to be valid. By incorporating these assumptions with the Shuttle guidance logic, a quick approximation can be made of the touchdown speed and downrange distance to an accuracy within 400 ft of the mainframe prediction.

Walyus, Keith D.↗

Kamodo’s Model-Agnostic Satellite Flythrough: Lowering the Utilization Barrier for Heliophysics Model Outputs

Heliophysics model outputs are increasingly accessible, but typically are not usable by the majority of the community unless directly collaborating with the relevant model developers. Prohibitive factors include complex file output formats, cryptic metadata, unspecified and often customized coordinate systems, and non-linear coordinate grids. Some pockets of progress exist, giving interfaces to various simulation outputs, but only for a small set of outputs and typically not with open-source, freely available packages. Additionally, the increasing array of tools built upon these sporadic interfaces are typically model-specific. We present Kamodo’s model-agnostic satellite flythrough capabilities as the solution to the utilization barrier for heliophysics model outputs. Developed at the Community Coordinated Modeling Center, these flythrough capabilities are built in Python upon a network of model-agnostic interfaces developed in collaboration with model developers, providing interpolation results the community can trust. Kamodo’s flythrough capabilities present the user with a growing variety of flythrough tools based upon a rapidly expanding library of heliophysics model outputs in several domains, currently including a variety of Ionosphere-Thermosphere-Mesosphere and global magnetosphere model outputs. Each capability is designed to be easily accessible via simplistic model-agnostic syntax, with the entire package freely available in the cloud on Github. Here, we describe the tools developed, include several sample applications for common science questions, demonstrate interoperability with selected packages, and summarize ongoing developments.

Software↗

The "limiting line" in mixed subsonic and supersonic flow of compressible fluids

It is well known that the vorticity for any fluid element is constant if the fluid is non-viscous and the change of state of the fluid is isentropic. When a solid body is placed in a uniform stream, the flow far ahead of the body is irrotational. Then if the flow is further assumed to be isentropic, the vorticity will be zero over the whole filed of flow. In other words, the flow is irrotational. For such flow over a solid body, it is shown by Theodorsen that the solid body experiences no resistance. If the fluid has a small viscosity, its effect will be limited in the boundary layer over the solid body and the body will have a drag due to the skin friction. This type of essentially isentropic irrotational flow is generally observed for a streamlined body placed in a uniform stream, if the velocity of the stream is kept below the so-called "critical speed." At the critical speed or rather at a certain value of the ratio of the velocity of the undisturbed flow and the corresponding velocity of sound, shock waves appear. This phenomenon is called the "compressibility bubble." Along a shock wave, the change of state of the fluid is no longer isentropic, although still adiabatic. This results in an increase in entropy of the fluid and generally introduces vorticity in an originally irrotational flow. The increase in entropy of the fluid is, of course, the consequence of changing part of the mechanical energy into heat energy. In other words, the part of fluid affected by the shock wave has a reduced mechanical energy. Therefore, with the appearance of shock waves, the wake of the streamline body is very much widened, and the drag increases drastically. Furthermore, the accompanying change in the pressure distribution over the body changes the aerodynamic moment acting on it and in the case of an airfoil decreases the lift force. All these consequences of the breakdown of isentropic irrotational flow are generally undesirable in applied aerodynamics. Its occurrence should be delayed as much as possible by modifying the shape or contour of the body. However, such endeavor will be very much facilitated if the cause or the criterion for the breakdown can be found first.

MACH NUMBER↗

Simple, Scalable, Script-Based Science Processor (S4P)

The development and deployment of data processing systems to process Earth Observing System (EOS) data has proven to be costly and prone to technical and schedule risk. Integration of science algorithms into a robust operational system has been difficult. The core processing system, based on commercial tools, has demonstrated limitations at the rates needed to produce the several terabytes per day for EOS, primarily due to job management overhead. This has motivated an evolution in the EOS Data Information System toward a more distributed one incorporating Science Investigator-led Processing Systems (SIPS). As part of this evolution, the Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) has developed a simplified processing system to accommodate the increased load expected with the advent of reprocessing and launch of a second satellite. This system, the Simple, Scalable, Script-based Science Processor (S42) may also serve as a resource for future SIPS. The current EOSDIS Core System was designed to be general, resulting in a large, complex mix of commercial and custom software. In contrast, many simpler systems, such as the EROS Data Center AVHRR IKM system, rely on a simple directory structure to drive processing, with directories representing different stages of production. The system passes input data to a directory, and the output data is placed in a "downstream" directory. The GES DAAC's Simple Scalable Script-based Science Processing System is based on the latter concept, but with modifications to allow varied science algorithms and improve portability. It uses a factory assembly-line paradigm: when work orders arrive at a station, an executable is run, and output work orders are sent to downstream stations. The stations are implemented as UNIX directories, while work orders are simple ASCII files. The core S4P infrastructure consists of a Perl program called stationmaster, which detects newly arrived work orders and forks a job to run the appropriate executable (registered in a configuration file for that station). Although S4P is written in Perl, the executables associated with a station can be any program that can be run from the command line, i.e., non-interactively. An S4P instance is typically monitored using a simple Graphical User Interface. However, the reliance of S4P on UNIX files and directories also allows visibility into the state of stations and jobs using standard operating system commands, permitting remote monitor/control over low-bandwidth connections. S4P is being used as the foundation for several small- to medium-size systems for data mining, on-demand subsetting, processing of direct broadcast Moderate Resolution Imaging Spectroradiometer (MODIS) data, and Quick-Response MODIS processing. It has also been used to implement a large-scale system to process MODIS Level 1 and Level 2 Standard Products, which will ultimately process close to 2 TB/day.

Lynnes, Christopher↗

Precision Asteroid Astrometry

Among the methods used to guide spacecraft to their destinations, Optical Navigation (OpNav) remains an effective option. OpNav makes use of star fields and small body ephemerides to precisely locate spacecraft. To facilitate accurate OpNav, the small body ephemerides must be constantly updated; asteroid orbits accumulate errors each year of a few milliarcseconds. Through extended exposures, taken with strategic offsets, a least-squares solution can be found that determines updated ephemeris data. This updated data can also be used by occultation astronomers to gain further information about the small bodies, including their size and shape. Using the 24-inch telescope at the Caltech Table Mountain Observatory (TMO), we capture two or more 180 second exposures of each target. These images, combined with a file for the predicted background star field and two reference files, are then processed through a series of scripts and programs. Starting with a prediction file and two to five exposures of the asteroid, the data is processed. This original data is about 32MB per observation. Once the data are reduced to only Right Ascension and Declination for each target, the data are ready for delivery. This consists of text only, and for each target takes about 80 bytes; this resulting data reduction is about five orders of magnitude. This method produces observed positions that are refined by about 12 milliarcseconds, a refinement that is accomplished almost nowhere else. The occultation observations that are facilitated by the ephemerides being refined also produce results that are not possible in any other way from ground-based observations.

Dial, Jason↗

Methodology and Application of HPC I/O Characterization with MPIProf and IOT

Combining the strengths of MPIProf and IOT, an efficient and systematic method is devised for I/O characterization at the per-job, per-rank, per-file and per-call levels of HPC programs running on the NASA Advanced Supercomputing Center. This method is applied to answer four I/O questions in this paper. A total of 13 MPI programs and 15 cases, ranging from 24 to 5968 ranks, are analyzed to establish the I/O landscape from answers to the four questions. Four of the 13 programs use MPI I/O and the behavior of their collective writes depends on the specific implementation of the MPI library used. The SGI MPT library, the prevailing MPI library for our systems, was found to gather small writes from a large number of ranks to perform larger writes by a small subset of collective buffering ranks. The number of collective buffering ranks invoked by MPT depends on the Lustre stripe count and the number of nodes used for the run. A demonstration of varying the stripe count to achieve double-digit speedup of one program's I/O was presented. Another program, which concurrently opens private files by all ranks and could potentially create a heavy load on the Lustre servers, was identified. The ability to systematically characterize I/O for a large number of programs running on a supercomputer, seek I/O optimization opportunity and identify programs that could cause a high load and instability on the filesystems is important for pursuing exascale in a real production environment.

Characterization↗