Smart-open is a library for efficient streaming of very large files from/to storages such as HDFS, WebHDFS, HTTP, HTTPS, SFTP, or local filesystem. It supports transparent, on-the-fly (de-)compression for a variety of different formats (gzip, bz2, etc.).

This package excludes the support of S3 and GCS.