توضیحات
ABSTRACT
Hadoop is a open source framework for automatic parallelization of computing tasks in distributed environment. Unfortunately programming for Hadoop comprise of certain challenges. It is very difficult to debug and understand Hadoop programs. We can make it a little simple by using a simplified version of the Hadoop cluster that runs locally on the developer’s machine. In this paper we describes how to set up such hadoop a cluster on a pc running Microsoft Windows. It also describes a way to integrate this cluster with a major Java development environment
INTRODUCTION
Hadoop is a free, Open source Java-based programming framework which used to process of large data sets in a
distributed computing environment or in cluster. Hadoop is part of the Apache project sponsored by the Apache Software Foundation[4]. Hadoop works on thousands of nodes involving thousands of terabytes of data. HDFS(Hadoop Distributed File System) is distributed file system facilitates rapid data transfer rates between nodes and allows the system to continue operating uninterrupted in case of a node failure by feature of fault tolerance[4]. Hadoop was inspired by Google’s MapReduce[6]. Apache Hadoop 2.x release supports for running Hadoop framework on Microsoft Windows environment. But due to deficiency of some windows native components (like hadoop.dll, winutils.exe, etc) in bin distribution of Apache Hadoop 2.x release encounter ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path.[1] Thus, we describe how to build bin native distribution from source codes, How to install, How to configure and run Hadoop in Windows Platform. Since hadoop is very complex environment we broke this approach into several smaller steps of configuration. Each step involves particular action will execute on setting some aspect of the system
Publisher:International Journal on Recent and Innovation Trends in Computing and Communication
Year:2015
By:Hemant Hingave,Prof. Rasika Ingle
File Information :English Language/3 Page/Size:341
Download:click
ناشر:International Journal on Recent and Innovation Trends in Computing and Communication
سال:2015
کاری از:Hemant Hingave,Prof. Rasika Ingle
اطلاعات فایل:زبان انگلیسی/3 صفحه/حجم:341
لینک دانلود:روی همین لینک کلیک کنید
نقد و بررسیها
هنوز بررسیای ثبت نشده است.