天天看點

Linux下快速删除大量小檔案(HP-UX也适用)1、建立一個空目錄 2、使用rsync同步删除3、rsync一些跟删除有關的參數

大俠們是否删除百萬千萬級甚至更多的小檔案吧,用rm -rf  指令非常慢,極度挑戰人類的耐性。這時可用rsync工具删除,測試過Linux和HP-UX都可以用。

先确定作業系統是否裝好rsync,HP-UX預設未裝rsync,到http://hpux.connect.org.uk/搜尋rsync包下載下傳安裝即可,記得先裝依賴包。

rsync使用的是替換原理。

1、建立一個空目錄

-bash-4.3# mkdir /mnt/empt

2、使用rsync同步删除

注意:目錄後面加上“/” ,/mnt/many/100w/是要删除的目錄

-bash-4.3# rsync --delete-before -a -H -v --progress --stats /mnt/empty /mnt/many/100w/

....

deleting 1W94.3MB/300029.63MB/Lib/__future__.py

.....

Number of files: 1 (dir: 1)

Number of created files: 0

Number of deleted files: 105,720 (reg: 100,000, dir: 5,720)

Number of regular files transferred: 0

Total file size: 0 bytes

Total transferred file size: 0 bytes

Literal data: 0 bytes

Matched data: 0 bytes

File list size: 0

File list generation time: 0.001 seconds

File list transfer time: 0.000 seconds

Total bytes sent: 46

Total bytes received: 6,339,527

sent 46 bytes  received 6,339,527 bytes  7,605.97 bytes/sec

total size is 0  speedup is 0.00

選項說明:

  • --delete-before 接收者在傳輸之前進行删除操作
  • -a 歸檔模式,表示以遞歸方式傳輸檔案,并保持所有檔案屬性
  • -H 保持硬連接配接的檔案
  • -v 詳細輸出模式

    --progress 在傳輸時顯示傳輸過程

  • --stats 給出某些檔案的傳輸狀态

一般不需要顯示進度,使用以下指令即可: -bash-4.3# rsync --delete-before -a -H /mnt/empty /mnt/many/100w/

删除完後隻剩下/mnt/many/100w/空目錄,裡面的檔案都被删除。

3、rsync一些跟删除有關的參數

-bash-4.3# rsync --help | grep delete

     --del                   an alias for --delete-during

     --delete                delete extraneous files from destination dirs

     --delete-before         receiver deletes before transfer, not during

     --delete-during         receiver deletes during the transfer

     --delete-delay          find deletions during, delete after

     --delete-after          receiver deletes after transfer, not during

     --delete-excluded       also delete excluded files from destination dirs

     --delete-missing-args   delete missing source args from destination

     --ignore-errors         delete even if there are I/O errors

     --max-delete=NUM        don't delete more than NUM files