随着現在越來越多的學python的在爬取一些網站的資料,有一些知名的網站有着反爬蟲,是以有的時候爬蟲比較困難
![](https://img.laitimes.com/img/_0nNw4CM6IyYiwiM6ICdiwiI0gTMx81dsQWZ4lmZf1GLlpXazVmcvwFciV2dsQXYtJ3bm9CX9s2RkBnVHFmb1clWvB3MaVnRtp1XlBXe0xCMy81dvRWYoNHLwEzX5xCMx8FesU2cfdGLwMzX0xiRGZkRGZ0Xy9GbvNGLpZTY1EmMZVDUSFTU4VFRR9Fd4VGdsYTMfVmepNHLrJXYtJXZ0F2dvwVZnFWbp1zczV2YvJHctM3cv1Ce-cmbw5iN0ATN3EDZ4QTOhljM3kjMzYzX4EDO1UTMwIzLclDMyIDMy8CXn9Gbi9CXzV2Zh1WavwVbvNmLvR3YxUjLyM3Lc9CX6MHc0RHaiojIsJye.png)
import requests
import bs4
res = requests.get(“https://search.bilibili.com/all?keyword=%E7%BC%96%E7%A8%8B&from_source=nav_search_new&order=totalrank&duratinotallow=0&tids_1=0”)
res.text
soup = bs4.BeautifulSoup(res.text,“html.parser”)
titles = soup.find_all(“li”,class_=“video-item matrix”)
for each in titles:
print(each.a[‘title’])