Please use this identifier to cite or link to this item:
標題: 基於Hadoop 框架建立巨量資料分析處理模型研究
Design and Implementation of a Big Data Processing and Analysis Framework on the Hadoop Ecosystem
作者: 簡玠忠
Chien, Chien-Chung
關鍵字: Hadoop;Hadoop;MapReduce;雲端運算;分散式運算;大量資料處理;MapReduce;Could Computing;Distributed Computing;Big Data
出版社: 資訊科學與工程學系所
引用: [1] [2] [3] [4] [5] [6] [7] [8] [9] White, Tom ,”Hadoop: The Definitive Guide”, O''Reilly Media,10 May 2012 [10] [11] [12] [13] [14] [15] [16]
在本論文中,我們基於Hadoop Ecosystem概念,整合HBase、 Pig等相關元件,了解各個元件的概念與應用,進而建構出Log的分析架構,提供企業或有巨量資料需要分析之單位,以此平台達到快速處理與分析巨量資料之目的。

A research conducted by IDC indicates that information worldwide has doubled its amount in every two years, which has broken Moore’s Law. Besides, , with the increase of digital information and the universalization of Cloud Computing, it is pridicted that the amount of digital data will reach 35ZB by 2020. In addition, one third of digital data will be stored and processed through Cloud Computing.
Consequently, large amounts of digital data will be the business opportunity for corporations and individuals. However, while we analyze the mega data, the limit of current technology is still a problem because most of these data is non-structured and stored in different systems. As a result, it is hard to analyze by database and other conventional ways. The new ways to retrieve, research, discover, and analyze the mega data would be the challenge issues of data processing. The main purpose of this research is to build a mega data processing platform on a private cloud environment , so as to enable efficiently and promptly analyze the potential profits of mega data
Based on the Hadoop Ecosystem, we integrate Hbase, Pig, and other similar tools, understand their purpose goal and usage of each tool, and construct a log data analysis framework, providing enterprises or organizations with a platform that achieve high-speed process and analysis of mega data information.
其他識別: U0005-0102201315141200
Appears in Collections:資訊科學與工程學系所

Files in This Item:
File Description SizeFormat Existing users please Login
nchu-102-5099056008-1.pdf1.53 MBAdobe PDFThis file is only available in the university internal network    Request a copy
Show full item record

Google ScholarTM


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.