hadoop dfs的小技艺

hadoop dfs的小技巧

在测试hadoop的dfs的各种命令的时候，突然发现dfs -rmr支持通配符操作（前提是要在hadoop的bin目录下执行）

补充点：ls cat也支持通配符的

?

例如执行ls后有如下文件

?

1. [dikar@dikar?~]$?hadoop?dfs?-ls??
2. opts=??-Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20.2/bin/../logs?-Dhadoop.log.file=hadoop.log?-Dhadoop.home.dir=/home/dikar/Program/hadoop-0.20.2/bin/..?-Dhadoop.id.str=?-Dhadoop.root.logger=INFO,console?-Djava.library.path=/home/dikar/Program/hadoop-0.20.2/bin/../lib/native/Linux-i386-32?-Dhadoop.policy.file=hadoop-policy.xml??
3. class=org.apache.hadoop.fs.FsShell??
4. params=-ls??
5. Found?3?items??
6. -rw-r--r--???2?dikar?supergroup????????622?2011-03-05?16:55?/user/dikar/ta??
7. -rw-r--r--???2?dikar?supergroup??????????9?2011-03-05?16:51?/user/dikar/test1??
8. -rw-r--r--???2?dikar?supergroup?????????10?2011-03-05?16:51?/user/dikar/test2??

?然后执行rmr test*

?

1. [dikar@dikar?bin]$?hadoop?dfs?-rmr?test*??
2. opts=??-Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20.2/bin/../logs?-Dhadoop.log.file=hadoop.log?-Dhadoop.home.dir=/home/dikar/Program/hadoop-0.20.2/bin/..?-Dhadoop.id.str=?-Dhadoop.root.logger=INFO,console?-Djava.library.path=/home/dikar/Program/hadoop-0.20.2/bin/../lib/native/Linux-i386-32?-Dhadoop.policy.file=hadoop-policy.xml??
3. class=org.apache.hadoop.fs.FsShell??
4. params=-rmr?test*??
5. Deleted?hdfs://dikar:54310/user/dikar/test1??
6. Deleted?hdfs://dikar:54310/user/dikar/test2??

?在用ls 查看

?

1. [dikar@dikar?bin]$?hadoop?dfs?-ls??
2. opts=??-Dhadoop.log.dir=/home/dikar/Program/hadoop-0.20.2/bin/../logs?-Dhadoop.log.file=hadoop.log?-Dhadoop.home.dir=/home/dikar/Program/hadoop-0.20.2/bin/..?-Dhadoop.id.str=?-Dhadoop.root.logger=INFO,console?-Djava.library.path=/home/dikar/Program/hadoop-0.20.2/bin/../lib/native/Linux-i386-32?-Dhadoop.policy.file=hadoop-policy.xml??
3. class=org.apache.hadoop.fs.FsShell??
4. params=-ls??
5. Found?1?items??
6. -rw-r--r--???2?dikar?supergroup????????622?2011-03-05?16:59?/user/dikar/ta??

?更多信息请查看?java进阶网?http://www.javady.com