爬虫之多线程，提高效率
2021-03-02 04:26
标签：gif style opened write rom 效率 网易云 header proc 下载网易云 使用多线程爬虫 爬虫之多线程，提高效率 标签：gif style opened write rom 效率 网易云 header proc 原文地址：https://www.cnblogs.com/3-wusen/p/14414168.html
arr = ["http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3"]
import random
def downsong(url):
res = requests.get(url,headers=headers)
with open(f"D://music/{str(random.randint(1,100))}.mp3","wb")as f:
f.write(res.content)
from multiprocessing.dummy import Pool
p = Pool(4)
p.map(downsong,arr)
print("下载完毕")
下一篇：关于稀疏数组