Tuesday, 1 April 2014

BIG DATA/HADOOP INTERVIEW QUESTIONS AND ANSWERS FOR EXPERIENCED : DBA

Big Data & Hadoop Interview Questions and Answers for Experienced developer and DBA
Hey here I come with Big data and Hadoop Interview questions with answers for experienced Database developers and fresher Big data and Hadoop developers. Here are most impotent Hadoop and Big data interview questions with Answers soon you will get these in pdf format. 

What is Big Data ? 
Big data is data that exceeds the processing capacity of traditional database systems. The data is too big, moves too fast, or doesn’t fit the strictures of your database architectures. To gain value from this data, you must choose an alternative way to process it. 

Name any org. who is generating Big Data ? 
Facebook,Google What is NoSQL? NoSQL is a whole new way of thinking about a database. NoSQL is not a relational database. The reality is that a relational database model may not be the best solution for all situations. The easiest way to think of NoSQL, is that of a database which does not adhering to the traditional relational database management system (RDMS) structure. Sometimes you will also see it revered to as 'not only SQL'. 

We have already SQL then Why NoSQL? 
 NoSQL is high performance with high availability, and offers rich query language and easy scalability. NoSQL is gaining momentum, and is supported by Hadoop, MongoDB and others. The NoSQL Database site is a good reference for someone looking for more information. 

What is Hadoop and where did Hadoop come from ? 
By Mike Olson: The underlying technology was invented by Google back in their earlier days so they could usefully index all the rich textural and structural information they were collecting, and then present meaningful and actionable results to users. There was nothing on the market that would let them do that, so they built their own platform. Google’s innovations were incorporated into Nutch, an open source project, and Hadoop was later spun-off from that. Yahoo has played a key role developing Hadoop for enterprise applications. 

What problems can Hadoop solve ? 
By Mike Olson: The Hadoop platform was designed to solve problems where you have a lot of data — perhaps a mixture of complex and structured data — and it doesn’t fit nicely into tables. It’s for situations where you want to run analytics that are deep and computationally extensive, like clustering and targeting. That’s exactly what Google was doing when it was indexing the web and examining user behavior to improve performance algorithms. 

What is the Difference between Hadoop and Apache Hadoop ? 
There is no diff, Hadoop, formally called Apache Hadoop, is an Apache Software Foundation project. 

What is the difference between SQL and NoSQL? Is NoSQL follow relational DB model ? 
No 

Why would NoSQL be better than using a SQL Database ? 
And how much better is it? It would be better when your site needs to scale so massively that the best RDBMS running on the best hardware you can afford and optimized as much as possible simply can't keep up with the load. How much better it is depends on the specific use case (lots of update activity combined with lots of joins is very hard on "traditional" RDBMSs) - could well be a factor of 1000 in extreme cases. 

Name the modes in which Hadoop can run ? 
Hadoop can be run in one of three modes: 
i. Standalone (or local) mode
ii. Pseudo-distributed mode 
iii. Fully distributed mode 

What do you understand by Standalone (or local) mode ? 
There are no daemons running and everything runs in a single JVM. Standalone mode is suitable for running MapReduce programs during development, since it is easy to test and debug them. 

What is Pseudo-distributed mode ? 
The Hadoop daemons run on the local machine, thus simulating a cluster on a small scale. 

What does /var/hadoop/pids do ? 
It stores the PID. 

What is the full form of HDFS ? 
Hadoop Distributed File System 

What is the idea behind HDFS ? 
HDFS is built around the idea that the most efficient approach to storing data for processing is to optimize it for write once, and read many approach. 

Where does HDFS fail ? 
Cannot support large number of small files as the file system metadata increases with every new file, and hence it is not able to scale to billions of files. This file system metadata is loaded into memory and since memory is limited, so is the number of files supported. 

What are the ways of backing up the file-system metadata ? 
There are 2 ways of backing up the filesystem metadata which maps different filenames with their data stored as different blocks on various data nodes: Writing the filesystem metadata persistently onto a local disk as well as on a remote NFS mount. Running a secondary namenode. 

What is Namenode in Hadoop ? 
Namenode is the node which stores the filesystem metadata i.e. which file maps to what block locations and which blocks are stored on which datanode. What is DataNode in Hadoop? Namenode is the node which stores the filesystem metadata i.e. which file maps to what block locations and which blocks are stored on which datanode. 

What is Secondary NameNode ? 
The Secondary NameNode (SNN) is an assistant daemon for monitoring the state of the cluster HDFS, Like the NameNode, Each cluster has one SNN, and it typically resides on its own machine as well. 

What is JobTracker in Hadoop ? 
The JobTracker is the service within Hadoop that farms out MapReduce tasks to specific nodes in the cluster, ideally the nodes that have the data, or at least are in the same rack. 

What are the functions of JobTracker in Hadoop ? 
Once you submit your code to your cluster, the JobTracker determines the execution plan by determining which files to process, assigns nodes to different tasks, and monitors all tasks as they are running. If a task fail, the JobTracker will automatically relaunch the task, possibly on a different node, up to a predefined limit of retries. There is only one JobTracker daemon per Hadoop cluster. It is typically run on a server as a master node of the cluster. 

What is MapReduce in Hadoop ? 
Hadoop MapReduce (Hadoop Map/Reduce) is a software framework for distributed processing of large data sets on compute clusters of commodity hardware. It is a sub-project of the Apache Hadoop project. The framework takes care of scheduling tasks, monitoring them and re-executing any failed tasks. 

What are the Hadoop configuration files ? 
1. hdfs-site.xml 
2. core-site.xml 
3. mapred-site.xml
Visit Our New Site for HR Interview Questions Answers http://www.interviewboat.com/Company/GetCompany
Sponsored Ads

72 comments:

  1. Thanks for sharing such useful information on the blog and refer the link Oracle Training in Chennai

    ReplyDelete
  2. Oracle Training in Chennai27 February 2015 at 03:05

    Awesome Blogs share more information and refer the link Oracle Training in Chennai

    ReplyDelete
  3. Oracle Training

    The information you posted here is useful to make my career better keep updates..If anyone want to become an oracle certified professional reach FITA Oracle Training Center in Chennai, which offers Best Oracle Course in Chennai with years of experienced professionals.

    ReplyDelete
  4. Oracle Training Institutes in Chennai

    I get a lot of great information from this blog. Recently I did oracle certification course at a leading academy. If anyone interested to learn best Oracle Training in Chennai visit FITA academy which offer PL SQL Training in Chennai.


    ReplyDelete
  5. Big Data Training Chennai

    I get a lot of great information from this blog. Thank you for your sharing this informative blog. Just now I have completed hadoop certification course at a leading academy. If you are looking for best Hadoop Training in Chennai visit FITA IT training and placement academy which offer Big Data Training in Chennai.

    ReplyDelete
  6. Salesforce Course in Chennai


    I have read your blog and i got a very useful and knowledgeable information from your blog.You have done a great job . If anyone want to get Salesforce Training in Chennai, Please visit FITA academy located at Chennai Velachery. Rated as No.1 Salesforce Training Institutes in Chennai.

    Salesforce Developer Training in Chennai | Salesforce Administrator Training in Chennai

    ReplyDelete
  7. Hi, I am Emi lives in Chennai. I am technology freak. I did Android mobile application development course in Chennai at reputed training institutes, this is very usful for me to make a bright carrer in IT industry. So If you looking for best Android Training Institute in Chennai please visit fita academy which offers real time Android Training in Chennai at reasonable cost.

    ReplyDelete
  8. Thanks for sharing the information about hadoop.This is really helpful me.I learned a lot of all information form this site.
    VMWare Training in chennai | VMWare Training chennai | VMWare course in chennai

    ReplyDelete
  9. An obligation of hadoop training in chennai appreciation is in place fororacle training in chennai giving the information about hadoop.This is oracle dba training in chennai genuinely helpful me.I took in a huge amount of all information outline this site.

    ReplyDelete
  10. Wow Great article.I like this article because this is very helpful for me.

    dot net training in chennai

    ReplyDelete
  11. Thanks for sharing this here. It was very useful to me.

    Hadoop Training in Chennai

    ReplyDelete
  12. Thanks for your informative post on Java application development. This open source platform assists software developers to create stunning mobile application with ease. Further, they can make use of this platform at free of cost. J2EE Training in Chennai | JAVA Training in Chennai

    ReplyDelete
  13. This is exactly what I was searching for. Awesome post. Thanks a bunch. Helped me in taking class for my students. Wish to follow your posts, keep writing! God Bless!
    Shashaa
    Dot Net training institutes in Chennai | Dot Net training institutes in Chennai | Dot Net training institutes in Chennai

    ReplyDelete
  14. This comment has been removed by the author.

    ReplyDelete
  15. Thanks for your informative article. Your pose helped me a lot to under the future in .Net mobile application development. .NET Training in Chennai

    ReplyDelete
  16. Learning new technology would give oneself a true confidence in the current emerging Information Technology domain. With the knowledge of big data the most magnificent cloud computing technology one can go the peek of data processing. As there is a drastic improvement in this field everyone are showing much interest in pursuing this technology. Your content tells the same about evolving technology. Thanks for sharing this.

    Hadoop Training in Chennai | Hadoop training institutes in chennai | Hadoop Training Chennai | Big Data Training in Chennai

    ReplyDelete
  17. Hello admin, thank you for your informative post on hadoop training in Chennai. It helped a lot in training my students during our hadoop training Chennai sessions. We at Fita, provide big data training in Chennai for students who are interested in choosing a career in big data.

    ReplyDelete
  18. I am reading your post from the beginning, it was so interesting to read & I feel thanks to you for posting such a good blog, keep updates regularly.
    Regards,
    sas training in Chennai|sas course in Chennai|sas training institute in Chennai

    ReplyDelete
  19. Pretty article! I found some useful information in your blog, it was awesome to read, thanks for sharing this great content to my vision, keep sharing.
    Regards,

    Python Training in Chennai|Python Classes in Chennai|Python Course in Chennai

    ReplyDelete
  20. Thanks Admin for sharing such a useful post, I hope it’s useful to many individuals for developing their skill to get good career.
    Regards,
    Informatica training in chennai|Informatica training center in Chennai|Informatica training chennai

    ReplyDelete
  21. Thanks for sharing this informative blog to our vision.
    Regards..
    Big Data Training in Chennai

    ReplyDelete
  22. I have finally found a Worth able content to read. The way you have presented information here is quite impressive. I have bookmarked this page for future use. Thanks for sharing content like this once again. Keep sharing content like this.

    Software testing training in chennai | Software testing institute in chennai | Manual testing training in Chennai

    ReplyDelete
  23. Dear admin, The way you have explained the concept is mezmerizing. Thank you so much for sharing tis worth able content with us. The concept taken here will be useful for my future programs and i will surely implement them in my study. Keep blogging article like this.


    Best JAVA Training institute in Chennai | Best JAVA Training in Chennai | Android training in chennai

    ReplyDelete
  24. This technical post helps me to improve my skills set, thanks for this wonder article I expect your upcoming blog, so keep sharing...
    Regards,
    Oracle Training in Chennai|Oracle DBA Training in Chennai

    ReplyDelete
  25. Thanks for sharing the big data & hadoop interview questions, it's really beneficial for me.
    Regards,

    Oracle Training in Chennai|Oracle DBA Training in Chennai|Oracle Training Institutes in Chennai

    ReplyDelete
  26. It is good collection of questions.

    Few questions i came accross

    1. Why can't we use Java primitive data types in Map Reduce?
    2. Explain how do you decide between Managed & External tables in hive
    3. Can we change the default location of Managed tables
    4. What are the factors that we consider while creating a hive table
    5. What are the compression techniques and how do you decide which one to use
    6. Co group in Pig
    7. How to include partitioned column in data - Hive
    9. What hadoop -put command do exactly
    10. What is the limit on Distributed cache size?
    11. Handling skewed data
    12. What are the Different joins in hive?
    13. Explain about SMB join in Hive

    Hope it will help

    Thanks,

    Nithiya

    Salesforce training in

    Chennai

    ReplyDelete
  27. Thank you for have taken your valuable time to providing us with your value information relate to your staying with us.we are sincerely concern Most important, you Keep the major
    Dot net Training in chennai

    ReplyDelete
  28. Wonderful article, very useful and well explanation. Your post is extremely incredible. I will refer this to my candidates...
    Dot net Training in chennai

    ReplyDelete
  29. The blog you provided gives me more information about Hadoop. I admired by reading this unique content.
    Cloud Computing Training in Chennai

    ReplyDelete
  30. There are lots of information about latest technology and how to get trained in them, like this have spread around the web, but this is a unique one according to me. The strategy you have updated here will make me to get trained in future technologies. By the way you are running a great blog. Thanks for sharing this.

    Hadoop Training in Chennai

    ReplyDelete
  31. Thanks for sharing informative post. Big data is a term that portrays the substantial volume of information; both organized and unstructured that immerses a business on an everyday premise. To know more details please visit Big Data Training in Chennai | Primavera Training in Chennai

    ReplyDelete
  32. It is really very useful and informative and thanks for sharing this article.
    abap-training in chennai

    ReplyDelete
  33. Thank you very Much for your valuable information, please keep posting.

    Oracle Apps Training

    MS Dynamics AX Training

    ReplyDelete
  34. This hadoop interview questions are very useful for all freshers.It is a wonderful effort.We want more questions.
    Java Training in Chennai

    ReplyDelete
  35. very informative blog. interview questiones provided here are very helpful for the freshers
    Manual Testing Training in

    Chennai

    ReplyDelete
  36. Really informative post. Big data is a term that portrays the substantial volume of information; both organized and unstructured that immerses a business on an everyday premise. To know more details please visit Big Data Training in Chennai | Primavera Training in Chennai

    ReplyDelete
  37. Thanks for sharing.Its very useful.You have clearly explained about big date.
    Android Training in Chennai

    ReplyDelete
  38. Great!it is informative blog.nowadays,bigdata and hadoop is more important technology which is useful for improve our knowledge to learn more things about this.thanks you for sharing the valuable information to us.CCNA Training in Chennai

    ReplyDelete
  39. hadoop is a important technology in these criteria and we got more knowledge and valuable information from your blog thanks for sharing this information.

    dot net training in chennai

    ReplyDelete
  40. I like this concept and it is useful , now a days hadoop is becoming an important topic thanks for sharing these ideas.


    dot net training in chennai

    ReplyDelete
  41. I like this concept and it is interesting , now a days it is becoming popular and also it is technologically useful.thanks for sharing

    dot net training in chennai

    ReplyDelete
  42. Amazing..You have explained clearly about Hadoop/Big data..You interview are very useful for me to know more about hadoop..Your question and answer pattern is more useful for me to understand..Keep on blogging..
    Linux training in chennai

    ReplyDelete
  43. this blog will be more useful for those who wants to attend their interviews in a well performing capability. thank you for sharing the blog with us...
    Veritas cluster training in Chennai

    ReplyDelete
  44. awesome information about interview questions for hadoop for DBA. its really helpful those who need to take a interview based on the DBA based profile.
    Data warehousing Training in Chennai

    ReplyDelete
  45. This hadoop questions are very useful for all.Gives the easy understanding answers.thanks for this information.
    Websphere MQ Training in Chennai

    ReplyDelete
  46. Salesforce.com is an american company which offfers CRM based cloud services and it is loved globally for it quality services
    salesforce training in chennai|salesforce training institute in chennai | salesforce course in chennai

    ReplyDelete
  47. You have clearly explained about hadoop interview questions..Its very useful for guys who are searching job..Keep on blogging..
    weblogic training in chennai

    ReplyDelete
  48. the blog is about the interview questions will be much useful for those who wants to attend their interviews. thank you for sharing the blog with us.

    SALESFORCE TRAINING IN CHENNAI

    ReplyDelete
  49. A very nice guide. I will definitely follow these tips. Thank you for sharing such detailed article. I am learning a lot from you.


    Peridot Systems Chennai Reviews

    ReplyDelete
  50. Thanks for the informative article. This is one of the best resources I have found in quite some time. Nicely written and great info. I really cannot thank you enough for sharing.

    SAP training in Chennai

    ReplyDelete
  51. Thanks for the good words! Really appreciated. Great post. I’ve been commenting a lot on a few blogs recently, but I hadn’t thought about my approach until you brought it up.

    SEO training in Adyar

    ReplyDelete
  52. Thank you very Much for your valuable information, please keep posting.
    unix training in chennai

    ReplyDelete
  53. Professional Expert level Android Training in chennai, Android App Development
    Android Training | Android App Development | Training in chennai

    ReplyDelete