https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format en a blog about Debian and self-hosting Thu, 12 May 2016 14:07:00 +0000 PluXml https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463062041-1 https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463062041-1 @Tanguy : Yes. Initially I thought archive should be extracted at first, like: cat file.zip | bsdtar -xf- | bsdtar_pack_it_to_tar but there was no need to do so. Thu, 12 May 2016 14:07:00 +0000 Romiras https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463061753-1 https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463061753-1 @Romiras : Well yes, this is exactly what my article was about! Thu, 12 May 2016 14:02:00 +0000 Tanguy https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463061661-1 https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463061661-1 Finally I've found the way! This worked for me: wget -qO- http://example.org/file.zip | bsdtar -cf - @- > converted.tar One can pass additional filters, for example: cat file.zip | bsdtar -cf - @- | filter1 | filter2 | filter3 Thu, 12 May 2016 14:01:00 +0000 Romiras https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463059350-1 https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463059350-1 @Tanguy : I want to convert from ZIP-archive to tarball on-the-fly through pipe. My Zip file can be located remotely or locally. For example if I read remote Zip wget -qO- http://example.org/file.zip | bsdtar -xvf- it will extract files locally. Instead I need to pass through pipe for additional filters, like nc, gzip or whatever. Thu, 12 May 2016 13:22:00 +0000 Romiras https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463058953-1 https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463058953-1 @Romiras : That depends on what you have, and what you want to do exactly. Do you already have an archive, or do you want to create one? What do you want to do with it, do you want to transmit it to some remote host, allow people to donwload it, unpack it? Thu, 12 May 2016 13:15:00 +0000 Tanguy https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463057920-1 https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1463057920-1 @Tanguy : I found your article very useful for me. Can you advice how do I stream ZIP-archive as TAR-archive though pipe instead of unpacking files? Thu, 12 May 2016 12:58:00 +0000 Romiras https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1418767886-1 https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1418767886-1 > it will store the whole archive in memory before starting to extract it. Not true. It doesn't need to. The PKZIP format doesn't need this final index actually. It is there for redundancy. The very same information is available along the archive. That's why 'zip -FF' can repair a truncated archive. Try this: 1- zip a folder with many files 2- split the archive in 2 pieces using 'split' 3- cat <first part> | bsdtar xf - This last step will successfully extract what is stored into the arhive until it encounters unexpected EOF. Tue, 16 Dec 2014 22:11:00 +0000 pini https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1418637678-1 https://tanguy.ortolo.eu/blog/article134/bsdtar-change-archive-format/#c1418637678-1 @pini : Yes, you can use bsdtar to unzip in a stream, which can be useful for organizing your command line, but that will not provide the material advantages of streaming, as it will store the whole archive in memory before starting to extract it. So my explanation still stands: ZIP is not a streamable format, as it does requires to store the full archive before being able to extract it, even though bsdtar can hide that and fake a streaming usage by storing it in memory. Mon, 15 Dec 2014 10:01:00 +0000 Tanguy