首页 诗词 字典 板报 句子 名言 友答 励志 学校 网站地图
当前位置: 首页 > 教程频道 > 其他教程 > 互联网 >

替hive设置输出压缩的参数

2012-07-02 
为hive设置输出压缩的参数!-- map output compress begin--propertynamemapred.compress.map.output

为hive设置输出压缩的参数

<!-- map output compress begin--><property>  <name>mapred.compress.map.output</name>  <value>true</value></property><property>  <name>mapred.output.compress</name>  <value>true</value></property><property>  <name>hive.exec.compress.output</name>  <value>true</value>  <description> This controls whether the final outputs of a query (to a local/hdfs file or a hive table) is compressed. The compression codec and other options are determined from hadoop config variables mapred.output.compress* </description></property><property>  <name>hive.exec.compress.intermediate</name>  <value>true</value>  <description> This controls whether intermediate files produced by hive between multiple map-reduce jobs are compressed. The compression codec and other options are determined from hadoop config variables mapred.output.compress* </description></property><property>  <name>mapred.output.compression.codec</name>  <value>org.apache.hadoop.io.compress.GzipCodec</value></property><property>  <name>mapred.map.output.compression.codec</name>  <value>org.apache.hadoop.io.compress.GzipCodec</value></property><property>  <name>mapred.output.compression.type</name>  <value>BLOCK</value></property><!-- map output compress end-->

热点排行