Omixon Cloud Gate - Free Bioinformatic Software

In order to be able to process the very large bioinformatics files on the cloud, we have developed a utility to transfer files of up to 5 terabytes in size to and from S3. This utility takes advantage of the parallel transfer capabilities of S3 and can achieve very high speeds of data transfer, depending on the capability of the network used.

The utility can be used to upload data to the cloud, download data from the cloud, and transfer data to and from Amazon instances running on the cloud. It also includes support for HDFS (hadoop distributed file system). It can be used as a simple command line utility, or can be plugged in to your own applications.

Main features of Cloud Gate
• Completely free.
• A simple command line utility, written in Java.
• Also has a simple Java API, so can be integrated and used easily from within any Java application.
• Parallel data transfer, using the S3 multipart upload functions.
• File size of up to 5 terabytes.
• Upload and download between your local machines and S3.
• Transfer data between cloud-based instances and S3.
• Transfer data between HDFS (hadoop distributed file system) and S3.

Transfer speeds:
• Between cluster compute instances (with extra-fast networking) and S3 - up to 300 megabytes per second.
• Between standard Amazon instances and S3 - typically between 10 and 40 megabytes per second.
• Upload speed to the cloud (and download speed from the cloud) is effectively only limited by the capability of the internet connection used, up to a current maximum of 300 megabytes per second.

Software Link: Omixon Cloud Gate -  Free Bioinformatic Software