运行在泊坞窗容器Hadoop集群集群、容器、泊坞窗、Hadoop

2023-09-11 08:45:04 作者:给脸你得要

我想运行一个多节点的Hadoop集群,以泊坞窗容器内的每个节点在不同主机上。此图片 - https://github.com/sequenceiq/hadoop-docker 行之有效开始的Hadoop在伪分布式模式,什么是修改这在不同的容器中的每个节点单独的EC2主机上的最简单的方法是什么?

I want to run a multi-node hadoop cluster, with each node inside a docker container on a different host. This image - https://github.com/sequenceiq/hadoop-docker works well to start hadoop in a pseudo distributed mode, what is the easiest way to modify this to have each node in a different container on a separate ec2 host?

推荐答案

我这样做是对两个不同的ubuntu主机上运行的主从节点两个容器。我没有用编织容器之间的联网。我加了容器的图像上泊坞窗枢纽账户DIV4。余以同样的方式安装的hadoop,作为其上安装了不同的主机。我已经添加了两个图像与coomands在此之上运行haddop:

I did this with two containers running master and slave nodes on two different ubuntu hosts. I did the networking between containers using weave. I have added the images of the containers on docker hub account div4. I installed hadoop in the same way, as its installed on different hosts. I have added the two images with coomands to run haddop on them here:

https://registry.hub.docker.com/u/div4/hadoop_master / https://registry.hub.docker.com/u/div4/hadoop_slave/