Python---去除txt檔案中重複的行數

1.前言：

        采用python中set()的概念，通過周遊原始文檔中的元素，并将其添加到set()中，然後根據set()的性質來判斷新的元素是否要被添加到新的文檔中去。最終生成的新的文檔即滿足所需。

2.代碼實作：

#coding:utf-8

readDir = "./original_file.txt"
writeDir = "./new_file.txt"
outfile=open(writeDir,"w")
f = open(readDir,"r")

lines_seen = set()  # Build an unordered collection of unique elements.

for line in f:
    line = line.strip('\n')
    if line not in lines_seen:
        outfile.write(line+ '\n')
        lines_seen.add(line)