Map reduce got stuck in the Webinar (3rd mapreduce lecture for Delhi_01_Nov batch)

pramod.luffy
Posts: 3
Joined: Tue Nov 24, 2015 11:28 am

Map reduce got stuck in the Webinar (3rd mapreduce lecture for Delhi_01_Nov batch)

Postby pramod.luffy » Wed Dec 02, 2015 3:39 am

Hello

The map reduce Job example ( Subscriber with Driver class aircel_runner) didnt complete in the Webinar it got stuck in between and the instructor didnt care to complete that .Even i am stuck in the same state .Please help .!

Please refer the snapshots for reference!
Nov_01_Delhi_Batch.jpg
Nov_01_Delhi_Batch.jpg (85.09 KiB) Viewed 10964 times
MrJob.jpg
MrJob.jpg (208.55 KiB) Viewed 10964 times

Tags:

edupristine
Finance Junkie
Posts: 722
Joined: Wed Apr 09, 2014 6:28 am

Re: Map reduce got stuck in the Webinar (3rd mapreduce lecture for Delhi_01_Nov batch)

Postby edupristine » Sat Dec 05, 2015 5:16 am

For the webinar of Driver class_aircel_runner refer link 4 (Listen after 1 Minute) . We are giving all 4 parts, so that there will be no confusion.

http://webinars.edupristine.com/Webinar ... 1214_1.mp4

http://webinars.edupristine.com/Webinar ... 1214_2.mp4

http://webinars.edupristine.com/Webinar ... 1214_1.mp4

http://webinars.edupristine.com/Webinar ... 1214_2.mp4

pramod.luffy
Posts: 3
Joined: Tue Nov 24, 2015 11:28 am

Re: Map reduce got stuck in the Webinar (3rd mapreduce lecture for Delhi_01_Nov batch)

Postby pramod.luffy » Thu Dec 10, 2015 11:48 am

Hi
Thanks for your reply!

But I checked the 4th video ! I couldn't find what i was asking for !! i.e completion of the Job which was getting stuck

regards
Pramod

edupristine
Finance Junkie
Posts: 722
Joined: Wed Apr 09, 2014 6:28 am

Re: Map reduce got stuck in the Webinar (3rd mapreduce lecture for Delhi_01_Nov batch)

Postby edupristine » Sat Dec 12, 2015 10:12 am

Hi Pramod,

An MR Job can get into stuck because of several reasons. Some of the common reasons are given below

1) Not enough resources in the environment to execute the job
2) Error in the program
3) Problem with the execution environment.

Here the job is running on a Virtual Machine and the performance of the Virtual Machine totally depends on the hardware configuration and performance of your laptop, the reason for this issue might be due to lack of resources. If your laptop has good configuration, increase the resource allocation to the VM.

If the nodemanager is not running, this issue will happen. Check the status of nodemanager in your VM and ensure that it is running properly.


The YARN job will get stuck if it is not able to launch containers for executing the map tasks and reduce tasks. Check the resource manager web UI (localhost:8088) and analyse the containers launched, memory used and the status of the job. You can check the logs also from there. Check if any other jobs are also staying stuck in the cluster.

Try running a sample mapreduce job for finding the wordcount also and see whether it is executing or not.

If you have further queries, please attach the screenshot of the resource manager UI with the status of this job and logs


Return to “Big Data & Hadoop”



Disclaimer

Global Association of Risk Professionals, Inc. (GARP®) does not endorse, promote, review or warrant the accuracy of the products or services offered by EduPristine for FRM® related information, nor does it endorse any pass rates claimed by the provider. Further, GARP® is not responsible for any fees or costs paid by the user to EduPristine nor is GARP® responsible for any fees or costs of any person or entity providing any services to EduPristine Study Program. FRM®, GARP® and Global Association of Risk Professionals®, are trademarks owned by the Global Association of Risk Professionals, Inc

CFA Institute does not endorse, promote, or warrant the accuracy or quality of the products or services offered by EduPristine. CFA Institute, CFA®, Claritas® and Chartered Financial Analyst® are trademarks owned by CFA Institute.

Utmost care has been taken to ensure that there is no copyright violation or infringement in any of our content. Still, in case you feel that there is any copyright violation of any kind please send a mail to abuse@edupristine.com and we will rectify it.