Configuring Hadoop and Starting Cluster services using Automation

We all always heard of Configuring Hadoop manually in a very typical and lengthy way by going to the different nodes separately but have you ever heard of configuring it without going to nodes.

Yes…In this Article we are going to configure it through Ansible tool with complete end to end Automation.

So lets begin ..

Now as Inventory file is ready, we have to start writing code for Namenode first.

💻Namenode Configuration

Now this code is ready to be executed, so lets just run the playbook to get desired environment.

We run the playbook successfully …further we can go to Namenode manually and check whether we got desired setup through automation or not.

We can see that softwares are transferred successfully and also services are running very fine.

💻Datanode Configuration

Now this code is ready to be executed, so lets just run the playbook to get desired environment.

We run the playbook successfully …further we can go to Datanode manually and check whether we got desired setup through automation or not.

From this above picture we can verify that Datanode services are also running very fine .

#hadoop dfsadmin -report

From above picture we can conclude Configured capacity of cluster = 6641680384 (6.19 gb)

This is how we configured this whole cluster.

--

--

Upcoming Engineer

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store