Engineering Papers⌕ Search

NASA NTRS · 20120010471

Data::Downloader

Abstract

Downloading and organizing large amounts of files is challenging, and often done using ad hoc methods. This software is capable of downloading and organizing files as an OpenSearch client. It can subscribe to RSS (Really Simple Syndication) feeds and Atom feeds containing arbitrary metadata, and maintains a local content addressable data store. It uses existing standards for obtaining the files, and uses efficient techniques for storing the files. Novel features include symbolic links to maintain a sane directory structure, checksums for validating file integrity during transfer and storage, and flexible use of server-provided metadata.

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Duggan, Brian. 2012-06-01. Data::Downloader. https://engineeringpapers.com/record/nasa%3A20120010471/data-downloader

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Engineering Papers by Indiciae: BibTeX · RIS.