码迷,mamicode.com
首页 > 编程语言 > 详细

python3爬取qq音乐并下载

时间:2018-11-29 23:22:48      阅读:508      评论:0      收藏:0      [点我收藏+]

标签:gen   qq音乐   page   com   info   搜索结果   append   界面   head   

本文参考Python 爬取qqmusic音乐url并批量下载

同学找我爬取一下qq音乐播放链接,包括歌词等信息打包成json,试了一下可以爬取。

一、找到qq音乐播放的url

技术分享图片

1.找到搜索页面返回的数据包

歌曲最终的播放链接时经过多次拼接的,首先找到qq音乐搜索歌曲界面,https://y.qq.com/portal/search.html#page=1&searchid=1&remoteplace=txt.yqq.top&t=song&w=%E5%91%A8%E6%9D%B0%E4%BC%A6

右键-检查-刷新-点击Network,ctrl+f,在控制台右面搜索第一首歌就会出现这个界面返回的json包

技术分享图片

这个请求的链接是:

url1:https://c.y.qq.com/soso/fcgi-bin/client_search_cp?ct=24&qqmusic_ver=1298&new_json=1&remoteplace=txt.yqq.song&searchid=64791389917821519&t=0&aggr=1&cr=1&catZhida=1&lossless=0&flag_qc=0&p=1&n=20&w=%E5%91%A8%E6%9D%B0%E4%BC%A6&g_tk=5381&jsonpCallback=MusicJsonCallback4053122785448291&loginUin=0&hostUin=0&format=jsonp&inCharset=utf8&outCharset=utf-8&notice=0&platform=yqq&needNewCode=0

这个链接中有两个关键字,n和w,分别是请求返回的歌曲条数和请求的歌曲名或歌手名,这是第一个链接。(w是unicode字符,我感觉直接中文也可以)

2.获得返回的数据包后开始解析

url1返回的数据包把头部 MusicJsonCallback4053122785448291 去掉后如下格式:

技术分享图片

技术分享图片

从返回的数据包中提取mid和strMediaMid,然后组合到第二个url中

url2:

‘https://c.y.qq.com/base/fcgi-bin/fcg_music_express_mobile3.fcg?&jsonpCallback=MusicJsonCallback&cid=205361747&songmid=‘ + mid + ‘&filename=C400‘ + strMediaMid + ‘.m4a&guid=6612300644‘

 这个链接如果在浏览器打开会下载一个文件 fcg_music_express_mobile3.fcg 打开之后可以看到vkey:

{"code":0,"cid":205361747,"userip":"183.197.0.92","data":{"expiration":80400,"items":[{"subcode":0,"songmid":"002eTq6539AsfN","filename":"C400001GuWCx14Gng9.m4a","vkey":"1F051B9378DC2CD04C0B6D2257E40D0F03E6FA042D076E462FEFF6534EFA4B579A47F084811B4BE893006805A9439224D286200FDE1598D0"}]}}

3.将url2获取的 vkey 和 strMediaMids 一起组合成最终的url

url3:  http://dl.stream.qqmusic.qq.com/C400‘ + strMediaMids[n] + ‘.m4a?vkey=‘ + vkey + ‘&guid=6612300644&uin=0&fromtag=66

 最终url(可以打开):http://dl.stream.qqmusic.qq.com/C400001GuWCx14Gng9.m4a?vkey=1F051B9378DC2CD04C0B6D2257E40D0F03E6FA042D076E462FEFF6534EFA4B579A47F084811B4BE893006805A9439224D286200FDE1598D0&guid=6612300644&uin=0&fromtag=66

二、下载歌曲

有了url下载就很简单了,用urllib.request.urlretrieve()下载。

urllib.request.urlretrieve(url, ‘F:\music\\‘+data[key][‘歌名‘]+‘.m4a‘)

 源码

源码中加入了保存json文件,方便调用读取。

  1 import json
  2 import requests
  3 import re
  4 import urllib
  5 import time
  6 
  7 def parse(keyword,num):
  8     #keyword:要搜索的歌名或者歌手名,num:搜索结果的条数
  9     url = https://c.y.qq.com/soso/fcgi-bin/client_search_cp?ct=24&qqmusic_ver=1298&new_json=1&remoteplace=txt.yqq.song  10           &searchid=57124856116396257&t=0&aggr=1&cr=1&catZhida=1&lossless=0&flag_qc=0&p=1&  11           n=+str(num)+&w=+str(keyword)+&g_tk=5381&jsonpCallback=MusicJsonCallback3695372008103126  12           &loginUin=0&hostUin=0&format=jsonp&inCharset=utf8&outCharset=utf-8&notice=0&platform=yqq&needNewCode=0
 13     print(url)
 14     #添加user-agent
 15     head = {user-agent:Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36}
 16 
 17     #第一次返回:MusicJsonCallback3695372008103126包
 18     response = requests.get(url, headers=head)
 19     response = response.text.strip("MusicJsonCallback3695372008103126()[]")
 20 
 21     #解析json
 22     json_data = json.loads(response)
 23     print(json_data)
 24 
 25     json_data = json_data[data][song][list]
 26     print(json_data)
 27     strMediaMids = []
 28     songmids = []
 29     srcs = {}
 30     songnames = []
 31     singers = []
 32     albumns = []
 33     songid = []
 34     #遍历所获取的列表,找到歌曲信息存储在list中
 35     for data in json_data:
 36         try:
 37             strMediaMids.append(data[file][strMediaMid])
 38             songmids.append(data[mid])
 39             songnames.append(data[name])
 40             singers.append(data[singer][0][name])
 41             albumns.append(data[album][name])
 42             songid.append(data[id])
 43         except:
 44             print(wrong)
 45 
 46     #将获取到的信息二次组装成url
 47     for n in range(0,len(strMediaMids)):
 48 
 49         #将strMediaMids和songmids重新组合到url中
 50         url2 = https://c.y.qq.com/base/fcgi-bin/fcg_music_express_mobile3.fcg?&jsonpCallback=MusicJsonCallback&cid=205361747&songmid= + songmids[n] + &filename=C400 + strMediaMids[n] + .m4a&guid=6612300644
 51         #获取返回文件并解析得到vkey
 52         response2 = requests.get(url2)
 53         json_data2 = json.loads(response2.text)
 54         vkey = json_data2[data][items][0][vkey]
 55         #这是最终的歌曲url
 56         song_url = http://dl.stream.qqmusic.qq.com/C400 + strMediaMids[n] + .m4a?vkey= + vkey + &guid=6612300644&uin=0&fromtag=66
 57 
 58         # 获取歌词文本
 59         refer = https://y.qq.com/n/yqq/song/ + songmids[n] + .html
 60         head = {
 61             user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36,
 62             Referer: refer}
 63         lyric_url = https://c.y.qq.com/lyric/fcgi-bin/fcg_query_lyric.fcg?nobase64=1&musicid=  64                     + str(songid[n]) + &callback=jsonp1&g_tk=5381&jsonpCallback=jsonp1&loginUin=0&hostUin=0&format=jsonp&inCharset=utf8&outCharset=utf-8&notice=0&platform=yqq&needNewCode=0
 65         response3 = requests.get(lyric_url, headers=head).text
 66         json_data3 = response3.strip( jsonp1()[])
 67         print(json_data3)
 68         jsonp1 = json.loads(json_data3)
 69         try:
 70             lyric = jsonp1[lyric]
 71         except:
 72             print(wrong)
 73         # print(lyric)
 74 
 75         # result = re.findall(r‘[\u4e00-\u9fa5]+‘, lyric)
 76         # lyric = ‘ ‘.join(result)
 77         data = {}
 78         data[歌手] = singers[n]
 79         data[歌名] = songnames[n]
 80         data[专辑] = albumns[n]
 81         data[url] = song_url
 82         data[lyric] = lyric
 83         data[songmid] = songmids[n]
 84         data[strMediaMids] = strMediaMids[n]
 85         data[songid] = songid[n]
 86         srcs[n] = data
 87     with open(str(keyword)+.json, w,encoding=utf-8) as f:
 88         json.dump(srcs, f)
 89 
 90 
 91 
 92 def download(keyword):
 93     with open(keyword+.json,r) as f:
 94         data = json.load(f)
 95     # print(data)
 96     for key in data:
 97         time.sleep(1)
 98         url = data[key][url]
 99         # print(url)
100         print(正在下载:,data[key][歌名],......)
101         try:
102             urllib.request.urlretrieve(url, F:\music\\+data[key][歌名]+.m4a)
103             # with open(str(data[key][‘歌名‘])+‘-‘+str(data[key][‘歌手‘])+‘.m4a‘,‘w‘) as f:
104             #     f.write(requests.get(url).content)
105         except:
106             print(下载+data[key][歌名]+失败)
107     print(下载完成!)
108 
109 
110 keyword = 周杰伦
111 num = 1
112 parse(keyword, num)
113 download(keyword)

 

 有错误欢迎指正!

 

python3爬取qq音乐并下载

标签:gen   qq音乐   page   com   info   搜索结果   append   界面   head   

原文地址:https://www.cnblogs.com/szj22233060/p/10041335.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!