C++博客-herb-随笔分类-Hadoophttp://www.cppblog.com/herb/category/15522.html我要靠谱→hello world!zh-cnSat, 22 Jan 2011 19:05:30 GMTSat, 22 Jan 2011 19:05:30 GMT60HDFS简介http://www.cppblog.com/herb/archive/2011/01/10/138235.htmlherbherbMon, 10 Jan 2011 01:57:00 GMThttp://www.cppblog.com/herb/archive/2011/01/10/138235.htmlhttp://www.cppblog.com/herb/comments/138235.htmlhttp://www.cppblog.com/herb/archive/2011/01/10/138235.html#Feedback0http://www.cppblog.com/herb/comments/commentRss/138235.htmlhttp://www.cppblog.com/herb/services/trackbacks/138235.html
目前HDFS支持的使用接口除了Java的还有，Thrift、C、FUSE、WebDAV、HTTP等。HDFS是以block-sized chunk组织其文件内容的，默认的block大小为64MB，对于不足64MB的文件，其会占用一个block，但实际上不用占用实际硬盘上的64MB，这可以说是HDFS是在文件系统之上架设的一个中间层。之所以将默认的block大小设置为64MB这么大，是因为block-sized对于文件定位很有帮助，同时大文件更使传输的时间远大于文件寻找的时间，这样可以最大化地减少文件定位的时间在整个文件获取总时间中的比例 。

  阅读全文

herb 2011-01-10 09:57 发表评论
]]>hadoop二次排序中对组合键，分区，分组的一点应用http://www.cppblog.com/herb/archive/2010/12/08/135785.htmlherbherbWed, 08 Dec 2010 03:13:00 GMThttp://www.cppblog.com/herb/archive/2010/12/08/135785.htmlhttp://www.cppblog.com/herb/comments/135785.htmlhttp://www.cppblog.com/herb/archive/2010/12/08/135785.html#Feedback0http://www.cppblog.com/herb/comments/commentRss/135785.htmlhttp://www.cppblog.com/herb/services/trackbacks/135785.html阅读全文

herb 2010-12-08 11:13 发表评论
]]>[转载]用 Hadoop 进行分布式并行编程(三)http://www.cppblog.com/herb/archive/2010/11/24/134504.htmlherbherbWed, 24 Nov 2010 05:52:00 GMThttp://www.cppblog.com/herb/archive/2010/11/24/134504.htmlhttp://www.cppblog.com/herb/comments/134504.htmlhttp://www.cppblog.com/herb/archive/2010/11/24/134504.html#Feedback0http://www.cppblog.com/herb/comments/commentRss/134504.htmlhttp://www.cppblog.com/herb/services/trackbacks/134504.html阅读全文

herb 2010-11-24 13:52 发表评论
]]>[转载]用 Hadoop 进行分布式并行编程(二)http://www.cppblog.com/herb/archive/2010/11/24/134503.htmlherbherbWed, 24 Nov 2010 05:51:00 GMThttp://www.cppblog.com/herb/archive/2010/11/24/134503.htmlhttp://www.cppblog.com/herb/comments/134503.htmlhttp://www.cppblog.com/herb/archive/2010/11/24/134503.html#Feedback0http://www.cppblog.com/herb/comments/commentRss/134503.htmlhttp://www.cppblog.com/herb/services/trackbacks/134503.html阅读全文

herb 2010-11-24 13:51 发表评论
]]>[转载]用Hadoop进行分布式并行编程(一)http://www.cppblog.com/herb/archive/2010/11/24/134502.htmlherbherbWed, 24 Nov 2010 05:50:00 GMThttp://www.cppblog.com/herb/archive/2010/11/24/134502.htmlhttp://www.cppblog.com/herb/comments/134502.htmlhttp://www.cppblog.com/herb/archive/2010/11/24/134502.html#Feedback0http://www.cppblog.com/herb/comments/commentRss/134502.htmlhttp://www.cppblog.com/herb/services/trackbacks/134502.html阅读全文

herb 2010-11-24 13:50 发表评论
]]>