![]() ![]() I am picking ubuntu server 12.04.3 server 64-bit osĪs mentioned we are setting up 4 node hadoop cluster, so please enter 4 as number of instances. please check amazon ec2 free-tier requirements, you may setup 3 node cluster with < 30gb storage size to avoid any charges. ![]() login to amazon web services, click on my account and navigate to amazon ec2 console Once you have signed up for amazon account. amazon ec2 comes with eligible free-tier instances. i already have aws account and going to skip the sign-up process. If you do not already have a account, please create a new one. you can also terminate your amazon ec2 instance anytime and by default it will delete your instance upon termination, so just be careful what you are doing. you can stop the instance anytime to avoid the charge, but you will loose the public ip and host and restarting the instance will create new ones. With 4 node clusters and minimum volume size of 8gb there would be an average $2 of charge per day with all 4 running instances. In part-2 i will cover the hadoop multi node cluster installation Setting up client access to amazon instances (using putty.) In part-1 i will cover infrastructure side as below (to generate private key – this will be used in putty to connect to ec2 instance) Windows client (to connect to amazon ec2 instance) we are going to setup 4 node hadoop cluster as below. depending on what works best – its important to note that there are multiple ways to achieve this and i am going to cover how to setup multi-node hadoop cluster on amazon ec2. After spending some time playing around on single-node pseudo-distributed cluster, it's time to get into real world hadoop. ![]()
0 Comments
Leave a Reply. |