Discussion:
Aspera File Transfer
Ron Wilson
2011-08-31 19:16:40 UTC
Permalink
I am interested if anyone has had any experience with Aspera File Transfer
System. Its called FASP. Does it work as claimed? How does it work etc.
Any information would be helpful. Their web site is pretty bland as to how
it actually achieves the claimed speeds
Thanks
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Alexander Taler
2011-08-31 19:29:11 UTC
Permalink
I am interested if anyone has had any experience with Aspera File Transfer
System. Its called FASP. Does it work as claimed? How does it work etc.
Any information would be helpful. Their web site is pretty bland as to how
it actually achieves the claimed speeds Thanks
I found this page pretty explanatory, perhaps I am more easily
satisfied. In brief, they are stripping away all of the TCP
overhead, which can be a severe bottleneck. Their claims ring
true to me.

http://www.asperasoft.com/en/technology/fasp_solution_3/the_fasp_solution_3

Alex
--
hsh: The {Human|Happy|History} shell http://www.nongnu.org/hsh/
DEvelopment REFined - Enabling your software team - http://deref.co.nz/
PGP: ID: 0x23DC453B FPR: 42D0 66C2 9FF8 553A 373A B819 4C34 93BA 23DC 453B
Ironic humor dragged down all the twilight minarets he reared . . .


_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Ron Wilson
2011-08-31 20:12:45 UTC
Permalink
Thanks for response. I was wondering how they manage to ensure what is sent
is what is received without the usual packet check/resend as that is what
seems to slow down ftp/http traffic the most. I am looking at moving 100's
of Gb traffic from USA West Coast to NZ and this system was recommended.
Just trying to find out what I can before we get to far advanced on
project.
Post by Ron Wilson
I am interested if anyone has had any experience with Aspera File
Transfer
System. Its called FASP. Does it work as claimed? How does it work etc.
Any information would be helpful. Their web site is pretty bland as to
how
it actually achieves the claimed speeds Thanks
I found this page pretty explanatory, perhaps I am more easily
satisfied. In brief, they are stripping away all of the TCP
overhead, which can be a severe bottleneck. Their claims ring
true to me.
http://www.asperasoft.com/en/technology/fasp_solution_3/the_fasp_solution_3
Alex
--
hsh: The {Human|Happy|History} shell http://www.nongnu.org/hsh/
DEvelopment REFined - Enabling your software team - http://deref.co.nz/
PGP: ID: 0x23DC453B FPR: 42D0 66C2 9FF8 553A 373A B819 4C34 93BA 23DC 453B
Ironic humor dragged down all the twilight minarets he reared . . .
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Stephen
2011-08-31 20:29:01 UTC
Permalink
Possible relevant:

http://en.wikipedia.org/wiki/UDP-based_Data_Transfer_Protocol


_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Hadley Rich
2011-08-31 20:42:16 UTC
Permalink
Post by Ron Wilson
I am looking at moving 100's
of Gb traffic from USA West Coast to NZ
Courier a disk.
--
http://nicegear.co.nz



_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Steve Holdoway
2011-08-31 20:50:05 UTC
Permalink
Post by Hadley Rich
Post by Ron Wilson
I am looking at moving 100's
of Gb traffic from USA West Coast to NZ
Courier a disk.
+1. Usually faster, and much, much cheaper.
--
Steve Holdoway <***@greengecko.co.nz>
http://www.greengecko.co.nz
MSN: ***@greengecko.co.nz
Skype: sholdowa


_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Ron Wilson
2011-08-31 20:53:12 UTC
Permalink
Disk Useless we will want this stuff down every day and it will run into
some big files we cannot afford to wait for disk. Also it is not point to
point it will be coming from the big studios on the West Coast USA to us.
Post by Steve Holdoway
Post by Hadley Rich
Post by Ron Wilson
I am looking at moving 100's
of Gb traffic from USA West Coast to NZ
Courier a disk.
+1. Usually faster, and much, much cheaper.
--
http://www.greengecko.co.nz
Skype: sholdowa
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Matthew Diesch
2011-08-31 20:56:19 UTC
Permalink
...And there's the answer. Damn my slow typing hands :-)
Post by Ron Wilson
Disk Useless we will want this stuff down every day and it will run into
some big files we cannot afford to wait for disk. Also it is not point to
point it will be coming from the big studios on the West Coast USA to us.
Post by Steve Holdoway
Post by Hadley Rich
Post by Ron Wilson
I am looking at moving 100's
of Gb traffic from USA West Coast to NZ
Courier a disk.
+1. Usually faster, and much, much cheaper.
--
http://www.greengecko.co.nz
Skype: sholdowa
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Steve Holdoway
2011-08-31 21:43:35 UTC
Permalink
Well, this is the method that Aardman Studios use ( well, used to use at
least as I've not checked up lately ), even though they had a dedicated
100Mbit connection.

Steve
Post by Ron Wilson
Disk Useless we will want this stuff down every day and it will run into
some big files we cannot afford to wait for disk. Also it is not point to
point it will be coming from the big studios on the West Coast USA to us.
Post by Steve Holdoway
Post by Hadley Rich
Post by Ron Wilson
I am looking at moving 100's
of Gb traffic from USA West Coast to NZ
Courier a disk.
+1. Usually faster, and much, much cheaper.
--
http://www.greengecko.co.nz
Skype: sholdowa
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
Steve Holdoway BSc(Hons) MNZCS <***@greengecko.co.nz>
http://www.greengecko.co.nz
MSN: ***@greengecko.co.nz
Skype: sholdowa
Ron Wilson
2011-08-31 21:47:07 UTC
Permalink
Fair enough. The real problems is HD movies. They are getting so big and
when you have to download all your content (as most of the big studios are
insisting on only supplying via Internet) a few hours of content ever day
can quickly slow things down.hence the need for faster transfer system.
Post by Steve Holdoway
Well, this is the method that Aardman Studios use ( well, used to use at
least as I've not checked up lately ), even though they had a dedicated
100Mbit connection.
Steve
Post by Ron Wilson
Disk Useless we will want this stuff down every day and it will run into
some big files we cannot afford to wait for disk. Also it is not point to
point it will be coming from the big studios on the West Coast USA to us.
Post by Steve Holdoway
Post by Hadley Rich
Post by Ron Wilson
I am looking at moving 100's
of Gb traffic from USA West Coast to NZ
Courier a disk.
+1. Usually faster, and much, much cheaper.
--
http://www.greengecko.co.nz
Skype: sholdowa
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
http://www.greengecko.co.nz
Skype: sholdowa
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Phillip Hutchings
2011-08-31 22:15:02 UTC
Permalink
Post by Ron Wilson
Fair enough. The real problems is HD movies. They are getting so big and
when you have to download all your content (as most of the big studios are
insisting on only supplying via Internet) a few hours of content ever day
can quickly slow things down.hence the need for faster transfer system.
It doesn't matter how fancy your program is, you'll always be stuck with NZ's crappy international transit. Moving a disk will be easier, though depending on how frequently it may not be cheaper. You'd have to contact your ISP and see how much it'd cost for a dedicated connection with the bandwidth needed to transfer in a reasonable time.

Fedex can easily overnight a disk between NZ and US, probably $100 a pop though. It all depends on what it's worth to you.
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Ron Wilson
2011-08-31 22:24:35 UTC
Permalink
Unfortunately no choice there. Sony Warner Bros etc are not in business of
supplying product on disk. They want to supply over the net and that is
understandable in this day. They probably supply 100's of companies around
the world and the logistics of putting it on disk compared with pushing it
out into the Internet just do not compare.
Bandwidth is not really a problem yet I have 36 Mbs and we can push that up
as needed.
Post by Phillip Hutchings
Post by Ron Wilson
Fair enough. The real problems is HD movies. They are getting so big and
when you have to download all your content (as most of the big studios
are
Post by Ron Wilson
insisting on only supplying via Internet) a few hours of content ever day
can quickly slow things down.hence the need for faster transfer system.
It doesn't matter how fancy your program is, you'll always be stuck with
NZ's crappy international transit. Moving a disk will be easier, though
depending on how frequently it may not be cheaper. You'd have to contact
your ISP and see how much it'd cost for a dedicated connection with the
bandwidth needed to transfer in a reasonable time.
Fedex can easily overnight a disk between NZ and US, probably $100 a pop
though. It all depends on what it's worth to you.
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Matthew Diesch
2011-08-31 20:55:11 UTC
Permalink
Post by Steve Holdoway
Post by Hadley Rich
Post by Ron Wilson
I am looking at moving 100's
of Gb traffic from USA West Coast to NZ
Courier a disk.
+1. Usually faster, and much, much cheaper.
Maybe faster to get the entire amount but much slower to get the first
part.
So it depends on whether you need *all* the data before you can start
working with it or if you can start working as soon as the data starts
arriving.
The old quote was (something like) "never underestimate the bandwidth of a
stationwagon full of tapes doing 100mph down the freeway"



_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Ron Wilson
2011-08-31 20:56:39 UTC
Permalink
It will be all movies so I guess that we will need all the product before we
can sue it
Post by Matthew Diesch
Post by Steve Holdoway
Post by Hadley Rich
Post by Ron Wilson
I am looking at moving 100's
of Gb traffic from USA West Coast to NZ
Courier a disk.
+1. Usually faster, and much, much cheaper.
Maybe faster to get the entire amount but much slower to get the first
part.
So it depends on whether you need *all* the data before you can start
working with it or if you can start working as soon as the data starts
arriving.
The old quote was (something like) "never underestimate the bandwidth of a
stationwagon full of tapes doing 100mph down the freeway"
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Matthew Poole
2011-08-31 21:46:17 UTC
Permalink
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Post by Ron Wilson
It will be all movies so I guess that we will need all the product
before we can sue it
heh. Nice Freudian slip you've got there, in the context of Big
Hollywood :P
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iD8DBQFOXqupTdEtTmUCdpwRApLLAJ90fSK5G0BsEHdHCIqGQ/JLTX4pXACgqo2C
nBhBthTci4dewiN0b9/gWVA=
=hZQn
-----END PGP SIGNATURE-----

_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Jaco
2011-08-31 22:17:14 UTC
Permalink
Looks interesting - never seen this before.
I'm seeing POSIX candidates, but having difficulty locating licensing
information - is this commercial, freeware or FLOSS?
Post by Ron Wilson
I am interested if anyone has had any experience with Aspera File Transfer
System. Its called FASP. Does it work as claimed? How does it work etc.
Any information would be helpful. Their web site is pretty bland as to how
it actually achieves the claimed speeds
Thanks
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Ron Wilson
2011-08-31 22:25:36 UTC
Permalink
Commercial
Post by Jaco
Looks interesting - never seen this before.
I'm seeing POSIX candidates, but having difficulty locating licensing
information - is this commercial, freeware or FLOSS?
Post by Ron Wilson
I am interested if anyone has had any experience with Aspera File Transfer
System. Its called FASP. Does it work as claimed? How does it work etc.
Any information would be helpful. Their web site is pretty bland as to how
it actually achieves the claimed speeds
Thanks
______________________________**_________________
http://www.linux.net.nz/cgi-**bin/mailman/listinfo/nzlug<http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug>
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Matt Cunningham
2011-08-31 22:51:23 UTC
Permalink
We have owned a few different UDP file transfer products over the years, Aspera being just one of them.
The studios in the US change software with each new CTO...
They do work as advertised, we can ensure internet file transfers for our clients to anywhere in the world given the constraint of each end's connection.

We have a 1Gb Ethernet Internet connection throttled to 100Mb/s at the moment. Most of the studios we deal with in the US are 1Gb or 10Gb these days but some still use T3 (45Mb/s). We can send a 100GB file to the US in about 2.5 hours if we wanted to but given the timezone difference and for error handling we usually send a few 10GB files at 10Mb/s each and it only takes a few hours.

Obviously we offer this as a service if you are interested.

If you were interested, I have a long history in this process and have been sending large files over the internet for 10+ years.
We have used many ISPs and are currently with FX Netowrks.

We used to courier tapes/disks but for video dailies it's too slow these days...

Regards
Matt Cunningham
MOB: +64 21 670 867
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
DIGIPOST
5 OWENS ROAD EPSOM AUCKLAND
PO BOX 99574 NEWMARKET, AUCKLAND 1149, NEW ZEALAND
T +64 9 630 1770 | F +64 9 623 0287
WWW.DIGIPOST.CO.NZ
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -


_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Ron Wilson
2011-08-31 22:55:58 UTC
Permalink
Thanks for that I am pretty sure we will end up going down the Aspera route
so was just getting what info I could. We also use FX among others and have
our own satellite connections as well. Time will no doubt tell if we have
choosen the right path <g>
Post by Matt Cunningham
We have owned a few different UDP file transfer products over the years,
Aspera being just one of them.
The studios in the US change software with each new CTO...
They do work as advertised, we can ensure internet file transfers for our
clients to anywhere in the world given the constraint of each end's
connection.
We have a 1Gb Ethernet Internet connection throttled to 100Mb/s at the
moment. Most of the studios we deal with in the US are 1Gb or 10Gb these
days but some still use T3 (45Mb/s). We can send a 100GB file to the US in
about 2.5 hours if we wanted to but given the timezone difference and for
error handling we usually send a few 10GB files at 10Mb/s each and it only
takes a few hours.
Obviously we offer this as a service if you are interested.
If you were interested, I have a long history in this process and have been
sending large files over the internet for 10+ years.
We have used many ISPs and are currently with FX Netowrks.
We used to courier tapes/disks but for video dailies it's too slow these days...
Regards
Matt Cunningham
MOB: +64 21 670 867
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
DIGIPOST
5 OWENS ROAD EPSOM AUCKLAND
PO BOX 99574 NEWMARKET, AUCKLAND 1149, NEW ZEALAND
T +64 9 630 1770 | F +64 9 623 0287
WWW.DIGIPOST.CO.NZ
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Matt Cunningham
2011-08-31 23:18:54 UTC
Permalink
There is also Signiant, Fastsoft, Digital Fountain Raptor etc.
Faspex is fairly ubiquitous these days and I think that's what most people use.
Did you want to do a test?

Matt

-----Original Message-----
From: nzlug-***@linux.net.nz [mailto:nzlug-***@linux.net.nz] On Behalf Of Ron Wilson
Sent: Thursday, 1 September 2011 10:56
To: NZLUG Mailing List
Subject: Re: [nzlug] Re: Aspera File Transfer

Thanks for that I am pretty sure we will end up going down the Aspera route
so was just getting what info I could. We also use FX among others and have
our own satellite connections as well. Time will no doubt tell if we have
choosen the right path <g>
Post by Matt Cunningham
We have owned a few different UDP file transfer products over the years,
Aspera being just one of them.
The studios in the US change software with each new CTO...
They do work as advertised, we can ensure internet file transfers for our
clients to anywhere in the world given the constraint of each end's
connection.
We have a 1Gb Ethernet Internet connection throttled to 100Mb/s at the
moment. Most of the studios we deal with in the US are 1Gb or 10Gb these
days but some still use T3 (45Mb/s). We can send a 100GB file to the US in
about 2.5 hours if we wanted to but given the timezone difference and for
error handling we usually send a few 10GB files at 10Mb/s each and it only
takes a few hours.
Obviously we offer this as a service if you are interested.
If you were interested, I have a long history in this process and have been
sending large files over the internet for 10+ years.
We have used many ISPs and are currently with FX Netowrks.
We used to courier tapes/disks but for video dailies it's too slow these days...
Regards
Matt Cunningham
MOB: +64 21 670 867
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
DIGIPOST
5 OWENS ROAD EPSOM AUCKLAND
PO BOX 99574 NEWMARKET, AUCKLAND 1149, NEW ZEALAND
T +64 9 630 1770 | F +64 9 623 0287
WWW.DIGIPOST.CO.NZ
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug

_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Ron Wilson
2011-08-31 23:20:27 UTC
Permalink
No test needed at this stage but will keep it in mind Thanks for information
Post by Matt Cunningham
There is also Signiant, Fastsoft, Digital Fountain Raptor etc.
Faspex is fairly ubiquitous these days and I think that's what most people use.
Did you want to do a test?
Matt
-----Original Message-----
Behalf Of Ron Wilson
Sent: Thursday, 1 September 2011 10:56
To: NZLUG Mailing List
Subject: Re: [nzlug] Re: Aspera File Transfer
Thanks for that I am pretty sure we will end up going down the Aspera route
so was just getting what info I could. We also use FX among others and have
our own satellite connections as well. Time will no doubt tell if we have
choosen the right path <g>
Post by Matt Cunningham
We have owned a few different UDP file transfer products over the years,
Aspera being just one of them.
The studios in the US change software with each new CTO...
They do work as advertised, we can ensure internet file transfers for our
clients to anywhere in the world given the constraint of each end's
connection.
We have a 1Gb Ethernet Internet connection throttled to 100Mb/s at the
moment. Most of the studios we deal with in the US are 1Gb or 10Gb these
days but some still use T3 (45Mb/s). We can send a 100GB file to the US
in
Post by Matt Cunningham
about 2.5 hours if we wanted to but given the timezone difference and for
error handling we usually send a few 10GB files at 10Mb/s each and it
only
Post by Matt Cunningham
takes a few hours.
Obviously we offer this as a service if you are interested.
If you were interested, I have a long history in this process and have
been
Post by Matt Cunningham
sending large files over the internet for 10+ years.
We have used many ISPs and are currently with FX Netowrks.
We used to courier tapes/disks but for video dailies it's too slow these days...
Regards
Matt Cunningham
MOB: +64 21 670 867
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
-
Post by Matt Cunningham
DIGIPOST
5 OWENS ROAD EPSOM AUCKLAND
PO BOX 99574 NEWMARKET, AUCKLAND 1149, NEW ZEALAND
T +64 9 630 1770 | F +64 9 623 0287
WWW.DIGIPOST.CO.NZ
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
-
Post by Matt Cunningham
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
_______________________________________________
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
--
*Ron Wilson*
_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Jaco
2011-09-05 01:40:08 UTC
Permalink
Been using rsync for what feels like forever (I'm starting to use it
rather than cp/mv), but just curios on other and/or better ways of doing
things:

zsync (zsync.moria.org.uk) looks like an interesting take on rsync.

Anyone have any great 'fu skills they'd like to share on this, or any
other standards/protocols/programs that'll make the best of my network
resources?

- J

_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
Jim Tittsler
2011-09-07 02:56:11 UTC
Permalink
Post by Jaco
zsync (zsync.moria.org.uk) looks like an interesting take on rsync.
zsync is handy if you are tracking the progress of an Ubuntu
pre-release. Once you have the first alpha/beta/whatever ISO, zsync
makes it easy to update to the next/final image.
http://nz.archive.ubuntu.com/ubuntu-releases/oneiric/

_______________________________________________
NZLUG mailing list ***@linux.net.nz
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug

Loading...