我已经打了一个真正的问题。我需要做一些k均值聚类500万矢量,每个约含32 COLS。 我尝试了Mahout的需要linux和我在窗口,我是从使用的是Linux操作系统和任何形式的模拟器限制。
I have hit a real problem. I need to do some Kmeans clustering for 5 million vectors, each containing about 32 cols. I tried out Mahout which requires linux and I am on windows, I am restrained from using a Linux OS and any sort of simulator.
任何人都可以提出一个k均值聚类算法,该算法可扩展高达5M的载体,可以快速收敛?
Can anyone suggest a KMeans clustering algorithm that is scalable upto 5M vectors and can converge quickly?
我已经测试了几个,但他们不会规模。这意味着它们是缓慢的,并采取永远完成。
I have tested a few but they wont scale. Which means they are slow and take forever to complete.
感谢
确定,那么,谁曾经想聚集大规模的数据集,这样做的唯一方法是使用Mahout的。它需要一个Linux平台。所以我只好用虚拟的盒子,放在Ubuntu的它,然后使用Mahout的。它是一个漫长的过程来建立Mahout中,但是这两个环节,我用如下:
OK, So who ever wants clustering for large scale datasets, the only way of doing so is to use Mahout. IT requires a linux platform. So I had to use virtual box, placed Ubuntu on it and then used Mahout. Its a lengthy procedure to set up Mahout, but the two links that I used are as follows.
的http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster)
的http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster)