.
================================================
FILE: README.md
================================================
***
一个神奇的工具箱,拿回你的个人信息。
👉⚡使用说明 ⚡| 视频演示 | English | 获取最新维护版本 | TG交流群
### 🗣️ TG交流群:[加入群组](https://t.me/+b-Rdy7_9QuwyMGI1)
👍 推荐 RapidProxy 代理IP:
👍 推荐 BestProxy 代理IP:
👍 推荐 ThorData 代理IP:
### 开发者回忆录
点击展开👉 开发者回忆录
#### 场景一
小明一如往常打开 Chrome 浏览器逛着论坛,贴吧,一不小心点开了网页上的广告,跳转到了京东商城,下意识去关闭窗口时发现 (**OS:咦?京东怎么知道我最近心心念念的宝贝呢?刚好我正需要呢!**),既然打开了那就看看商品详情吧 (**OS:哎哟不错哦**),那就下单试试吧!
#### 场景二
小白听着网易云音乐的每日推荐歌单无法自拔 (**OS:哇!怎么播放列表里都是我喜欢的音乐风格?网易云音乐太棒了吧!深得我心啊!黑胶会员必须来一个!**),逛着知乎里的“如何优雅的XXX?”,“XXX是怎样一种体验?”,“如何评价XXX?” (**OS:咦?这个问题就是我刚好想问的,原来早已有人提问!什么???还有几千条回答!!进去逛逛看!**)
#### 场景三
小达上班时不忘充实自己,逛着各大技术论坛博客园、CSDN、开源中国、简书、掘金等等,发现首页的内容推荐太棒了(**OS:这些技术博文太棒了,不用找就出来了**),再打开自己的博客主页发现不知不觉地自己也坚持写博文也有三年了,自己的技术栈也越来越丰富(**OS:怎么博客后台都不提供一个数据分析系统呢?我想看看我这几年来的发文数量,发文时间,想知道哪些博文比较热门,想看看我在哪些技术上花费的时间更多,想看看我过去的创作高峰期时在晚上呢?还是凌晨?我希望系统能给我更多指引数据让我更好的创作!**)
看到以上几个场景你可能会感叹科技在进步,技术在发展,极大地改善了我们的生活方式。
但当你深入思考,你浏览的每个网站,注册的每个网站,他们都记录着你的信息你的足迹。
细思恐极的背后是自己的个人数据被赤裸裸的暴露在互联网上并且被众多的公司利用用户数据获得巨额利益,如对用户的数据收集分析后进行定制的广告推送,收取高额广告费。但作为数据的生产者却没能分享属于自己的数据收益。
#### 想法
如果有一个这样的工具,它能帮你拿回你的个人信息,它能帮你把分散在各种站点的个人信息聚合起来,它能帮你分析你的个人数据并给你提供建议,它能帮你把个人数据可视化让你更清楚地了解自己。
> 你是否会需要这样的工具呢? 你是否会喜欢这样的工具呢?
基于以上,我着手开发了 **[INFO-SPIDER](https://github.com/kangvcar/InfoSpider)** 👇👇👇
### What is INFO-SPIDER
INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱,旨在安全快捷的帮助用户拿回自己的数据,工具代码开源,流程透明。并提供数据分析功能,基于用户数据生成图表文件,使得用户更直观、深入了解自己的信息。
目前支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通、中国电信、知乎、哔哩哔哩、网易云音乐、QQ好友、QQ群、生成朋友圈相册、浏览器浏览历史、12306、博客园、CSDN博客、开源中国博客、简书。
详细使用说明参照[使用说明文档](https://infospider.vercel.app)或[视频教程](https://www.bilibili.com/video/BV14f4y1R7oF/)
你可以在 [](https://gitter.im/Info-Spider/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge) 与我们一起交流学习
### Features
- 安全可靠:本项目为开源项目,代码简洁,所有源码可见,本地运行,安全可靠。
- 使用简单:提供 GUI 界面,只需点击所需获取的数据源并根据提示操作即可。
- 结构清晰:本项目的所有数据源相互独立,可移植性高,**所有爬虫脚本在项目的 [Spiders](https://github.com/kangvcar/InfoSpider/tree/master/Spiders) 文件下**。
- 数据源丰富:本项目目前支持多达24+个数据源,持续更新。
- 数据格式统一:爬取的所有数据都将存储为json格式,方便后期数据分析。
- 个人数据丰富:本项目将尽可能多地为你爬取个人数据,后期数据处理可根据需要删减。
- 数据分析:本项目提供个人数据的可视化分析,目前仅部分支持。
- 文档丰富:本项目包含完整全面的[使用说明文档](https://infospider.vercel.app)和[视频教程](https://www.bilibili.com/video/BV14f4y1R7oF/)
### Screenshot

### QuickStart
#### 依赖安装
1. 安装[python3](https://www.python.org/downloads/)和Chrome浏览器
2. 安装与Chrome浏览器相同版本的[驱动](http://chromedriver.storage.googleapis.com/index.html)
3. 安装依赖库 `pip install -r requirements.txt`
> 如果您在这一步操作遇到问题,可以获取[免安装版InfoSpider](https://mbd.pub/o/bread/aZiTlJo=)
#### 工具运行
1. 进入 tools 目录
2. 运行 `python3 main.py`
3. 在打开的窗口**点击数据源按钮**, 根据提示**选择数据保存路径**
4. 弹出的浏览器**输入用户密码**后会自动开始爬取数据, 爬取完成浏览器会自动关闭.
5. 在对应的目录下可以**查看下载下来的数据**(xxx.json), **数据分析图表**(xxx.html)
### 购买服务
> ***限量发售中...***,[去看看](https://mbd.pub/o/bread/aZiTlJo=)
1. InfoSpider 最新维护版本
2. 更全面的个人数据分析
3. 免去安装程序的所有依赖环境,便捷,适合小白
4. 已打包好的程序,双击即可运行程序
5. 手把手教你如何打包 InfoSpider
6. 开发者一对一技术支持
7. ***购买后即可免费获得即将发布的全新2.0版本***
购买链接
### 数据源
- [x] GitHub
- [x] QQ邮箱
- [x] 网易邮箱
- [x] 阿里邮箱
- [x] 新浪邮箱
- [x] Hotmail邮箱
- [x] Outlook邮箱
- [x] 京东
- [x] 淘宝
- [x] 支付宝
- [x] 中国移动
- [x] 中国联通
- [x] 中国电信
- [x] 知乎
- [x] 哔哩哔哩
- [x] 网易云音乐
- [x] QQ好友([cjh0613](https://github.com/cjh0613/python-pub/blob/1c308fe90386f6d6e69e2202bb0c4acd4857576f/%E8%8E%B7%E5%8F%96QQ%E5%A5%BD%E5%8F%8B%E5%88%97%E8%A1%A8.py))
- [x] QQ群([cjh0613](https://github.com/cjh0613/python-pub/blob/1c308fe90386f6d6e69e2202bb0c4acd4857576f/%E8%8E%B7%E5%8F%96QQ%E5%A5%BD%E5%8F%8B%E5%88%97%E8%A1%A8.py))
- [x] 生成朋友圈相册
- [x] 浏览器浏览历史
- [x] 12306
- [x] 博客园
- [x] CSDN博客
- [x] 开源中国博客
- [x] 简书
### 数据分析
- [x] 博客园
- [x] CSDN博客
- [x] 开源中国博客
- [x] 简书
### 计划
- 提供web界面操作,适应多平台
- 对爬取的个人数据进行统计分析
- 融合机器学习技术、自然语言处理技术等对数据深入分析
- 把分析结果绘制图表直观展示
- 添加更多数据源...
### Visitors

### Developers want to say
1. 该项目解决了个人数据分散在各种各样的公司之间,经常形成数据孤岛,多维数据无法融合的痛点。
2. 作者认为该项目的最大潜力在于能把多维数据进行融合并对个人数据进行分析,是个人数据效益最大化。
3. 该项目使用爬虫手段获取数据,所以程序存在时效问题(需要持续维护,根据网站的更新做出修改)。
4. 该项目的结构清晰,所有数据源相互独立,可移植性高,所有爬虫脚本在项目的[Spiders](https://github.com/kangvcar/InfoSpider/tree/master/Spiders)文件下,可移植到你的程序中。
5. 目前该项目v1.0版本仅在Windows平台上测试,Python 3.7,未适配多平台。
6. 计划在v2.0版本对项目进行重构,提供web端操作与数据可视化,以适配多平台。
7. 本项目[INFO-SPIDER](https://github.com/kangvcar/InfoSpider)代码已开源,欢迎star支持。
### Contributors
### License
GPL-3.0
### Star History
[](https://star-history.com/#kangvcar/InfoSpider&Date)
================================================
FILE: README_EN.md
================================================
***
A magic toolbox to get back your personal information.
Documentation | Video Demo
### Donate
Support Me!
[Paypal](https://paypal.me/kangvcar?locale.x=zh_XC)
### Developer Memoir🌈
Click to expand👉 Developer Memoir🌈
#### Scenes 1
As usual, Xiao Ming opened the Chrome browser to browse the BBS, Tieba. Accidentally, Xiaoming opened the advertisement on the web page and jumped to JingDong Mall. When he went to close the window subconsciously, he found that (OS: it was just the product I needed!) How would JD know?Now that I've opened it, let's see the details of the product! Not bad. (OS: Give it a try!)
#### Scenes 2
Bai listens to the netease cloud music daily recommended song list can not get out of it (OS: wow! Why the playlist full of my favorite music styles? How great the netease cloud music! Love it so much! I have to buy a mumbership), strolling through ZhiHu's "How elegant XXX?, "What kind of experience is XXX?, "How do you evaluate XXX? (OS: Huh? This question is just what I want to ask, it has already been asked! What?? Thousands of answers!! Go inside and have a look!)
#### Scenes 3
Xiao Da never forget to enrich himself at work. As the major technical cnblog, CSDN, OSChina, JianShu, JueJin, etc., he find the homepage content recommendation is great (OS: these technical net posts are so great. I don't have to look for it as it came out). When he open the blog home page unconsciously,he found himself stick to write blog for three years, its technology stack is becoming more and more rich (OS: how to blog background does not provide a data analysis system? I want to see how many posts I've done over the years, when I've done it, which posts are hot, which technologies I've spent more time on, and which times I've been at my peak in the evenings? In the wee hours? I hope the system can give me more guidance data so that I can create better! Looking at the above scenes, you may sigh over the progress of technology, which has greatly improved our way of life. )
#### Idea
If you have a tool like this, it can help you get your personal information back, it can help you aggregate your personal information from various sites, it can help you analyze your personal data and give you Suggestions, it can help you visualize your personal data so that you can know yourself better.
> Would you need such a tool? Would you like such a tool?
Based on the above, I started to develop **[INFO-SPIDER](https://github.com/kangvcar/InfoSpider)** 👇👇👇
### What is INFO-SPIDER
INFO-SPIDER is a crawler toolbox with numerous data sources. It aims to help users get their data back safely and quickly. The tool code is open source and the process is transparent.
It also provides data analysis function and generates chart files based on user data, so that users can have a more intuitive and in-depth understanding of their own information.
Currently supported data sources including GitHub, QQ mailbox, NetEase mailbox, Ali mailbox, Sina mailbox, Hotmail mailbox, Outlook mailbox, JingDong, TaoBao, Alipay, China Mobile, China Unicom, China Telecom, ZhiHu, Bilibili, NetEase Cloud Music, QQ Friends, QQ Groups, WeChat Moments Album, Browser History, 12306, Cnblog, CSDN, OSCHINA, JianShu.
Refer to the [document](https://infospider.vercel.app) or [Video Demo](https://www.bilibili.com/video/BV14f4y1R7oF/) for details
You can communicate with us on [](https://gitter.im/Info-Spider/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge)
### Features
- Safe and Reliable: this project is open source, all source code visible, local operation, safe and reliable.
- Easy to Use: to provide a GUI interface, just click the data source you want to get and follow the prompts.
- Clear Structure: All the data sources of the project are independent from each other, and their portability is high. All crawler scripts are under the [Spiders](https://github.com/kangvcar/InfoSpider/tree/master/Spiders) catalogue.
- Rich Data Sources: This project currently supports up to 24+ data sources, which are constantly updated.
- Uniform Data Format: All crawled data will be stored in JSON format.
- Rich Personal Data: This project will crawl as much personal data as possible for you, and later data processing can be reduced as needed.
- Data Analysis: This project provides visual analysis of personal data, which is currently only partially supported.
- Documentation: This project contains complete [document](https://infospider.vercel.app) or [Video Demo](https://www.bilibili.com/video/BV14f4y1R7oF/) .
### Screenshot

### QuickStart
#### Requirements
- Step1: Install python3 and Chrome
- Step2: Install the same driver as the Chrome browser
- Step3: Run `pip install -r requirements.txt`
#### Run the project
- Step1: `cd tools`
- Step2: `python3 main.py`
- Step3: Click the Data Source button in the open window and select the data save path as prompted
- Step4: The popup browser will automatically start crawling data after entering the user password, and the browser will automatically close after crawling.
- Step5: In the corresponding directory, you can view the downloaded data (xxx. JSON), data analysis chart (XXx. HTML)
### Plan
- Provide web interface operation, adapt to multi-platform
- Conduct statistical analysis of personal data
- It integrates machine learning technology and natural language processing technology to analyze the data in depth
- Chart the analysis results visually
- Add more data sources...
### Visitors

### Contributors
### Sponsors

Thank you to JetBrains, who provide Open Source License for PyCharm!
### License
GPL-3.0
================================================
FILE: Spiders/A12306/main12306.py
================================================
import json
import datetime
import os
import sys
import requests
from tkinter.filedialog import askdirectory
# session = requests.session()
# cookie_dict = {
# 'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
# 'Cookie': 'JSESSIONID=4C46731EE8AC434BD50749C80CFCF67F; tk=dwjpjiuCb4bW06qo4oJMr5MKOw-4IRX_s1zBI-KyKSUq7-Ialm1110; RAIL_EXPIRATION=1554990611687; RAIL_DEVICEID=DNgKpgqbWzSopAqvFXfNXT3opSKTcwfTxGEIB_s60TyBtq6xHTqC1XAjQUm57eeWNoksjoHBbHDLx5HTeC_5lomXnDhs5MQ0Sv8XOOrSe2TBpQo4nlBQTR9GXc286CHhhprU0rQccB5BQ9kL5O4bfEcJADAKZq52; BIGipServerpassport=786956554.50215.0000; route=6f50b51faa11b987e576cdb301e545c4; BIGipServerotn=3973513482.24610.0000'
#
# }
# requests.utils.add_dict_to_cookiejar(session.cookies, cookie_dict)
# resp = session.post('https://kyfw.12306.cn/otn/index/initMy12306Api')
class Info(object):
def __init__(self, cookie):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except Exception:
pass
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
# 个人信息,json格式
def get_user_info(self):
url = 'https://kyfw.12306.cn/otn/modifyUser/initQueryUserInfoApi'
resp = self.session.get(url)
json_data = json.loads(resp.content.decode())
self.save_json('user_info.json', resp.content.decode())
return 0
# 未完成订单 https://kyfw.12306.cn/otn/queryOrder/queryMyOrderNoComplete
def get_OrderNoComplete(self):
url = 'https://kyfw.12306.cn/otn/queryOrder/queryMyOrderNoComplete'
data = '_json_att='
resp = self.session.post(url, data=data, verify=False)
json_data = json.loads(resp.content.decode())
self.save_json('user_order_no_complete.json', resp.content.decode())
return 0
# 未出行订单 https://kyfw.12306.cn/otn/queryOrder/queryMyOrder
def get_Order(self):
url = 'https://kyfw.12306.cn/otn/queryOrder/queryMyOrder'
from dateutil.relativedelta import relativedelta
# 时间可变
queryStartDate = (datetime.date.today() - relativedelta(months=+1)).strftime("%Y-%m-%d")
queryEndDate = datetime.datetime.now().strftime("%Y-%m-%d")
data = {'come_from_flag': 'my_order',
'pageIndex': 0,
'pageSize': 8,
'query_where': 'G',
'queryStartDate': queryStartDate,
'queryEndDate': queryEndDate,
'queryType': 1,
'sequeue_train_name': ''}
resp = self.session.post(url, data=data)
json_data = json.loads(resp.content.decode())
self.save_json('user_order.json', resp.content.decode())
return 0
# 联系人 https://kyfw.12306.cn/otn/passengers/query
def get_passengers(self):
url = 'https://kyfw.12306.cn/otn/passengers/query'
data = {'pageIndex': 1,
'pageSize': 10}
resp = self.session.post(url, data=data)
json_data = json.loads(resp.content.decode())
self.save_json('user_passengers.json', resp.content.decode())
return 0
# 车票快递地址 https://kyfw.12306.cn/otn/address/initApi
def get_address(self):
url = 'https://kyfw.12306.cn/otn/address/initApi'
data = None
resp = self.session.post(url, data=data)
json_data = json.loads(resp.content.decode())
self.save_json('user_address.json', resp.content.decode())
return 0
# 保险订单 https://kyfw.12306.cn/otn/insurance/queryMyIns
def get_insurance(self):
url = 'https://kyfw.12306.cn/otn/insurance/queryMyIns'
# 时间可变
from dateutil.relativedelta import relativedelta
queryStartDate = (datetime.date.today() - relativedelta(months=+1)).strftime("%Y-%m-%d")
queryEndDate = datetime.datetime.now().strftime("%Y-%m-%d")
data = {'come_from_flag': 'my_ins',
'pageIndex': 0,
'pageSize': 8,
'query_where': 'H',
'queryStartDate': queryStartDate,
'queryEndDate': queryEndDate,
'queryType': 1,
'sequeue_train_name': ''}
data = 'queryStartDate=2019-04-09&queryEndDate=2019-04-09&pageSize=8&pageIndex=1&query_where=H&sequeue_train_name=&come_from_flag=my_ins'
resp = self.session.post(url, data=data)
self.save_json('user_insurance.json', resp.content.decode())
return 0
# 历史订单 https://kyfw.12306.cn/otn/queryOrder/queryMyOrder
def get_History_Order(self):
url = 'https://kyfw.12306.cn/otn/queryOrder/queryMyOrder'
from dateutil.relativedelta import relativedelta
cookie_dict = {'Referer': 'https://kyfw.12306.cn/otn/view/train_order.html'}
self.headers.update(cookie_dict)
# 时间可变
queryStartDate = (datetime.date.today() - relativedelta(months=+1)).strftime("%Y-%m-%d")
queryEndDate = datetime.datetime.now().strftime("%Y-%m-%d")
# data = {'come_from_flag': 'my_order',
# 'pageIndex': 0,
# 'pageSize': 8,
# 'query_where': 'H',
# 'queryStartDate': queryStartDate,
# 'queryEndDate': queryEndDate,
# 'queryType': 1,
# 'sequeue_train_name': ''}
data = 'come_from_flag=my_order&pageIndex=0&pageSize=8&query_where=H&queryStartDate=2019-06-01&queryEndDate=2019-06-21&queryType=1&sequeue_train_name=15659358815'
resp = self.session.post(url, headers=self.headers, data=data, verify=False)
self.save_json('user_history_order.json', resp.content.decode())
return 0
# 会员信息
def get_level(self):
url = 'https://cx.12306.cn/tlcx/memberInfo/memberPointQuery'
data = 'queryType=0'
resp = self.session.post(url, data=data)
self.save_json('user_level.json', resp.content.decode())
return 0
def save_json(self, name, ret):
# file_path = os.path.join(os.path.dirname(__file__) + '/' + name)
with open(self.path + os.sep + name, 'w', encoding='utf-8') as f:
f.write(ret)
if __name__ == '__main__':
pass
# a = Info()
# user = a.get_user_info()
# a.save_json('user.json', user)
# OrderNoComplete = a.get_OrderNoComplete()
# a.save_json('OrderNoComplete.json',OrderNoComplete)
# Order = a.get_Order()
# a.save_json('Order.json',Order)
# passengers = a.get_passengers()
# a.save_json('passengers.json',passengers)
# address = a.get_address()
# a.save_json('address.json',address)
# insurance = a.get_insurance()
# a.save_json('insurance.json',insurance)
# History_Order = a.get_History_Order()
# a.save_json('History_Order.json',History_Order)
#
# # 换json
# level = a.get_level()
# a.save_json('level.json',level)
================================================
FILE: Spiders/JdSpider/jd_more_info.py
================================================
# coding: utf8
import json
import os
import re
import sys
import requests
from lxml import etree
import datetime
import bs4
from pprint import pprint
from tkinter.filedialog import askdirectory
from tqdm import tqdm
from tqdm import trange
class JSpider(object):
def __init__(self, cookie, data_dir="./"):
# self.data_dir = data_dir
self.data_dir = askdirectory(title='选择信息保存文件夹')
if str(self.data_dir) == "":
sys.exit(1)
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
# 个人信息
def get_user_info(self):
url = 'https://wq.jd.com/user/info/QueryXBCreditScore?_=1556338705353&sceneval=2&g_login_type=1&callback=getCreditInfoCb&g_tk=2127038752&g_ty=ls'
self.headers['Referer'] = 'https://wqs.jd.com/my/asset.html'
resp = self.session.get(url, headers=self.headers).content.decode().replace('try{getCreditInfoCb(', '').replace(
');}catch(e){}', '')
json_data = json.loads(resp)['data']
url = 'https://api.m.jd.com/api?appid=pc_home_page&functionId=getBaseUserInfo&loginType=3'
resp = json.loads(self.session.get(url, headers=self.headers).content.decode())['returnObj']
json_data.append(resp)
str = json.dumps(json_data)
self.write_json('user_info.json', str)
def write_json(self, name, str):
#file_path = os.path.join(os.path.dirname(__file__) + '/' + name)
try:
# os.mkdir(os.path.join(self.data_dir, "./jd"))
os.mkdir(os.path.join(self.data_dir))
except OSError:
pass
# file_path = os.path.join(self.data_dir, './jd/' + name)
file_path = os.path.join(self.data_dir, name)
with open(file_path, 'w') as f:
f.write(str)
# 信用账单
def get_creditData(self):
url = 'https://trade.jr.jd.com/async/creditData.action'
resp = self.session.get(url, headers=self.headers)
self.write_json('creditData.json', resp.content.decode())
# 钱包概括
def get_browseDataNew(self):
url = 'https://trade.jr.jd.com/async/browseDataNew.action'
resp = self.session.get(url)
self.write_json('wallet.json', resp.content.decode())
# 收益账单
def get_income(self):
url = 'https://trade.jr.jd.com/centre/getOverviewInData.action'
resp = self.session.get(url)
self.write_json('income.json', resp.content.decode())
# 地址
def get_addr(self):
url = 'https://easybuy.jd.com/address/getEasyBuyList.action'
headers = {
'Host': 'easybuy.jd.com',
'Connection': 'keep-alive',
'Cache-Control': 'max-age=0',
'Upgrade-Insecure-Requests': '1',
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.103 Safari/537.36',
'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3',
'Referer': 'https://home.jd.com/',
'Accept-Encoding': 'gzip, deflate, br',
'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8'
}
resp = self.session.get(url, headers=headers)
obj_list = etree.HTML(resp.content.decode()).xpath('//div[@class="item-lcol"]')
json_list = []
for obj in obj_list:
item = {}
item['name'] = obj.xpath('./div[1]/div[1]/text()')[0].strip()
item['addr'] = obj.xpath('./div[2]/div[1]/text()')[0].strip()
item['detail_addr'] = obj.xpath('./div[3]/div[1]/text()')[0].strip()
item['mobile'] = obj.xpath('./div[4]/div[1]/text()')[0].strip()
item['tel'] = obj.xpath('./div[5]/div[1]/text()')[0].strip()
item['email'] = obj.xpath('./div[6]/div[1]/text()')[0].strip()
json_list.append(item)
self.write_json('addr.json', json.dumps(json_list))
# 银行卡
def get_YHK(self):
url = 'https://authpay.jd.com/card/queryBindCard.action'
resp = self.session.get(url, headers=self.headers)
item = {}
# print(resp.content.decode())
item['name'] = etree.HTML(resp.content.decode()).xpath('//span[contains(text(),"持卡人姓名")]/text()')[0].replace(
'持卡人姓名:', '')
item['mobile'] = etree.HTML(resp.content.decode()).xpath('//span[contains(text(),"手机号:")]/text()')[0].replace(
'手机号:', '')
item['last_num'] = etree.HTML(resp.content.decode()).xpath('//span[contains(text(),"尾号")]/text()')[0].replace(
'尾号', '')
str = json.dumps(item)
self.write_json('YHK_info.json', str)
# 小金库账单
def get_xjk_info(self):
url = 'https://xjk.jr.jd.com/gold/account'
resp = self.session.get(url)
self.write_json('xjk.json', resp.content.decode())
# 理财收益
def get_finance_income(self):
url = 'https://trade.jr.jd.com/ajaxFinance/queryFundInfo.action'
resp = self.session.get(url)
self.write_json('finance_income.json', resp.content.decode())
# 钢镚数
def get_GB_num(self):
url = 'https://gb.jd.com/asset/myassets.html?from=myzc-left-gb'
resp = self.session.get(url)
num = etree.HTML(resp.content.decode()).xpath('//em[@class="h-i-num"]/text()')[0]
str = json.dumps({'gb_num': num})
self.write_json('GB_num.json', str)
# 京东金融交易单
def get_JY_bill(self):
# 可获取多页,定义pageNo
url = 'https://trade.jr.jd.com/trade/tradebuynew.action?pageNo=0&pageSize=10&timeFlag=0&projectType=0&orderStatus=-1&date1=&date2='
resp = self.session.get(url, headers=self.headers)
self.write_json('jiaoyi_bill.json', resp.content.decode())
# 收藏店铺
def get_follow_shops(self):
url = 'https://t.jd.com/follow/vender'
resp = self.session.get(url)
ele = etree.HTML(resp.content.decode())
obj_list = ele.xpath('//div[@class="mf-shop-list "]/div')
json_list = []
for obj in obj_list:
item = {}
item['name'] = ''.join(obj.xpath('.//div[@class="shop-name"]//text()')).strip()
item['url'] = obj.xpath('.//div[@class="shop-name"]/a/@href')[0]
json_list.append(item)
str = json.dumps(json_list)
self.write_json('follow_shops.json', str)
# 收藏s商品
def get_follow_products(self):
url = 'https://t.jd.com/follow/product'
resp = self.session.get(url)
ele = etree.HTML(resp.content.decode())
obj_list = ele.xpath('//div[@class="mf-goods-list clearfix "]/div')
json_list = []
for obj in obj_list:
item = {}
item['name'] = ''.join(obj.xpath('.//div[@class="p-name"]//text()')).strip()
item['url'] = obj.xpath('.//div[@class="p-name"]/a/@href')[0]
item['price'] = ''.join(obj.xpath('.//div[@class="p-price"]/strong/@price')).strip()
item['status'] = ''.join(obj.xpath('.//div[@class="p-stats"]//text()')).strip()
json_list.append(item)
str = json.dumps(json_list)
self.write_json('follow_products.json', str)
# 收藏s商品
def get_cart(self):
url = 'https://cart.jd.com/cart.action'
resp = self.session.get(url)
ele = etree.HTML(resp.content.decode())
obj_list = ele.xpath('//div[@class="item-form"]')
json_list = []
for obj in obj_list:
item = {}
item['name'] = ''.join(obj.xpath('.//div[@class="p-name"]//text()')).strip()
item['skus'] = ''.join(obj.xpath('.//div[@class="cell p-props p-props-new"]//text()')).strip()
item['url'] = obj.xpath('.//div[@class="p-name"]/a/@href')[0]
item['price'] = ''.join(obj.xpath('.//div[@class="cell p-sum"]//text()')).strip()
item['num'] = ''.join(obj.xpath('.//div[@class="cell p-quantity"]//input/@value')).strip()
json_list.append(item)
str = json.dumps(json_list)
self.write_json('carts.json', str)
# 已购商品
def get_orders(self):
for i in [2020, 2019, 2018]:
url = 'https://order.jd.com/center/list.action?search=0&d={}&s=4096'.format(i)
# print(url)
resp = self.session.get(url)
# print(resp.content.decode('gbk'))
ele = etree.HTML(resp.content.decode('gbk'))
obj_list = ele.xpath('//table[@class="td-void order-tb"]/tbody')[1:]
json_list = []
url = 'https://order.jd.com/lazy/getOrderProductInfo.action'
try:
data = {
'orderWareIds': '{}'.format(
re.findall(r"ORDER_CONFIG\['orderWareIds'\]='([\d,]+)'", resp.content.decode('gbk'))[0]),
'orderWareTypes': '{}'.format(
re.findall(r"ORDER_CONFIG\['orderWareTypes'\]='([\d,]+)'", resp.content.decode('gbk'))[0]),
'orderIds': '{}'.format(
re.findall(r"ORDER_CONFIG\['orderIds'\]='([\d,]+)'", resp.content.decode('gbk'))[0]),
'orderTypes': '{}'.format(
re.findall(r"ORDER_CONFIG\['orderTypes'\]='([\d,]+)'", resp.content.decode('gbk'))[0]),
'orderSiteIds': '{}'.format(
re.findall(r"ORDER_CONFIG\['orderSiteIds'\]='([\d,]+)'", resp.content.decode('gbk'))[0]),
'sendPays': '{}'.format(
re.findall(r"ORDER_CONFIG\['sendPays'\]='([\d,]+)'", resp.content.decode('gbk'))[0]),
}
except Exception:
return
json_list = json.loads(self.session.post(url, data=data).content.decode('gbk'))
ret_list = []
for obj in obj_list:
try:
item = json_list[obj_list.index(obj)]
item['goods-number'] = ''.join(obj.xpath('.//div[@class="goods-number"]//text()')).strip()
item['consignee tooltip'] = ''.join(obj.xpath('.//div[@class="consignee tooltip"]/text()')).strip()
item['amount'] = ''.join(obj.xpath('.//div[@class="amount"]//text()')).strip()
item['order-shop'] = ''.join(obj.xpath('.//span[@class="order-shop"]//text()')).strip()
ret_list.append(item)
except Exception:
continue
self.write_json('jd_orders_{}.json'.format(i), json.dumps(ret_list))
# dict = {
# "orderType": 37,
# "erpOrderId": "%s"
# }
#
# obj_list = [{"orderType": 37, "erpOrderId": "%s" % (i.replace('tb-', ''))} for i in
# ele.xpath('//table[@class="td-void order-tb"]/tbody/@id')]
#
# url = 'https://ordergw.jd.com/orderCenter/app/1.0/?queryList={}'.format(json.dumps(obj_list))
# result_resp = self.session.get(url, headers=self.headers).content.decode().replace('null(', '')[:-1]
#############################################################################
def getAndStoreBoughtItems(self):
orderParseResults = []
currentYear = datetime.datetime.now().year
# print(currentYear)
for year in trange(currentYear, 2013-1, -1):
paramYear = year
if year == currentYear:
paramYear = 2
elif year < 2014:
paramYear = 3
# print("paramYear: ", paramYear)
r = self.getOnePageOrder(paramYear)
orderParseResults.extend(r)
datatable = self.changeOrderParseResultListToTable(orderParseResults)
self.writeDatatableIntoFile("allOrders.csv", datatable)
def getOnePageOrder(self, year):
orderParseResults = []
curPage = 1
while True:
# print("curPage: ", curPage)
params = {"search":"0", "d":str(year), "s":"4096", "page":str(curPage)}
resp = self.session.get(url="https://order.jd.com/center/list.action", params=params, headers=self.headers)
#print(resp.request.url)
#print(resp.text)
resultHtml = resp.text
r = self.parseOnePageOrder(resultHtml)
orderParseResults.extend(r)
if '下一页 ' in resultHtml or '最近没有下过订单哦~' in resultHtml:
# print("breakout")
break
curPage += 1
return orderParseResults
def parseOnePageOrder(self, resultHtml):
soup = bs4.BeautifulSoup(resultHtml, 'html.parser')
linkItems = soup.find_all(attrs={"name":"orderIdLinks"})
#print(linkItems)
urls = []
for e in linkItems:
url = e['href']
# print(url)
if url.startswith("http://"):
url = "https" + url[4:]
elif url.startswith("//"):
url = "https:" + url
elif url == "javascript:void(0);":
continue
elif not url.startswith("https://"):
raise Exception("Unsupported url: " + url)
urls.append(url)
#print(urls)
orderParseResults = []
for url in urls:
# print(url)
if url.startswith("https://details.jd.com/normal/item.action"):
orderParseResult = self.getOrderOfNormal(url)
elif url.startswith("https://chongzhi.jd.com/order/order_autoDetail.action"):
orderParseResult = self.getOrderOfChongzhi(url)
#elif url.startswith("https://home.jd.hk/"):
# # TODO
# pass
#elif url.startswith("https://huishou.jd.com/orderdetail"):
# pass
else:
continue
# raise Exception("TODO: unknown jd order detail url: " + url)
orderParseResults.append(orderParseResult)
return orderParseResults
def getOrderOfNormal(self, orderDetailUrl, resultHtml=None):
if resultHtml is None:
resp = self.session.get(url=orderDetailUrl, headers=self.headers)
resultHtml = resp.text
#print(resultHtml)
soup = bs4.BeautifulSoup(resultHtml, 'html.parser')
orderId = soup.find(id="orderid")["value"]
# print(orderId)
goodsTotal = soup.find(class_="goods-total")
#print(goodsTotal)
#print(goodsTotal.ul)
goodsTotalAmount = 0
orderTotalAmount = 0
for li in goodsTotal.ul.children:
if not isinstance(li, bs4.element.Tag):
continue
#TODO:check the result of find_all
label, txt = li.find_all("span")[:2]
#print(label.string, txt.string)
if "商品总额" in str(label.string):
goodsTotalAmount = float(txt.string.strip().replace("¥", ""))
elif "应付总额" in str(label.string):
orderTotalAmount = float(txt.string.strip().replace("¥", ""))
# print(goodsTotalAmount, orderTotalAmount)
statusString = ""
paymentTime = 0
eleStatus = soup.find(class_="state-txt")
statusString = eleStatus.string
# print(statusString)
payInfo = soup.find(id="pay-info-nozero")
#print(payInfo)
if payInfo:
divs = payInfo.find_all(class_="item")
# print(divs)
for div in divs:
label = div.find(class_="label").string.strip()
if "付款时间" in label:
paymentTime = div.find(class_="info-rcol").string.strip()
break
# print(paymentTime)
orderItemParseResults = []
goodsList = soup.find(class_="goods-list")
goodsListTableBody = goodsList.table.tbody
#print(goodsListTableBody)
trs = goodsListTableBody.find_all("tr")
#print(trs)
for tr in trs:
if tr.has_attr("style") and tr["style"] == "display: none":
break
tds = tr.find_all("td")
#print(tds)
productId = tds[2].string.strip()
productName = tds[1].find(class_="p-name").a.string.strip()
# print(productId, productName)
orderItemParseResult = {}
orderItemParseResult["productId"] = productId
orderItemParseResult["productName"] = productName
# TODO: more info
orderItemParseResults.append(orderItemParseResult)
orderParseResult = {}
orderParseResult["orderId"] = orderId
orderParseResult["paymentTime"] = paymentTime
orderParseResult["status"] = statusString
#orderParseResult["goodsTotalAmount"] = goodsTotalAmount
orderParseResult["orderTotalAmount"] = orderTotalAmount
orderParseResult["orderItems"] = orderItemParseResults
# TODO: more info
# pprint(orderParseResult)
return orderParseResult
def getOrderOfChongzhi(self, orderDetailUrl, resultHtml=None):
if resultHtml is None:
resp = self.session.get(url=orderDetailUrl, headers=self.headers)
resultHtml = resp.text
#print(resultHtml)
soup = bs4.BeautifulSoup(resultHtml, 'html.parser')
orderStateDiv = soup.find(id="orderstate")
#print(orderStateDiv)
orderId = orderStateDiv.find(class_="fl").string.replace(":"," ").split()[1]
# print(orderId)
statusString = orderStateDiv.find(class_="ftx-02").string
# print(statusString)
totalAmountDiv = soup.find(class_="total")
#print(totalAmountDiv)
orderTotalAmount = float(totalAmountDiv.find(class_="ftx-01").b.string.strip())
# print(orderTotalAmount)
orderInfoDiv = soup.find(id="orderinfo")
orderInfoUl = orderInfoDiv.find(class_="fore").dd.ul
#print(orderInfoUl)
paymentTime = 0
for li in orderInfoUl.find_all("li"):
if not li.string:
break
text = li.string.strip()
if "下单时间" in text:
paymentTime = text.replace("下单时间:", "")
break
# print(paymentTime)
orderItemParseResults = []
trs = orderInfoDiv.find(class_="p-list").table.tbody.find_all("tr")
#print(trs)
for i in range(1, len(trs)):
tr = trs[i]
tds = tr.find_all("td")
#print(tds)
productId = tds[0].string.strip()
productName = tds[1].div.a.string.strip()
orderItemParseResult = {}
orderItemParseResult["productId"] = productId
orderItemParseResult["productName"] = productName
# TODO: more info
orderItemParseResults.append(orderItemParseResult)
orderParseResult = {}
orderParseResult["orderId"] = orderId
orderParseResult["paymentTime"] = paymentTime
orderParseResult["status"] = statusString
orderParseResult["orderTotalAmount"] = orderTotalAmount
orderParseResult["orderItems"] = orderItemParseResults
# TODO: more info
# pprint(orderParseResult)
return orderParseResult
def changeOrderParseResultListToTable(self, orderParseResultList):
datatable = []
datatable.append(["订单id", "付款时间", "状态", "金额", "商品id", "商品名称"])
for orderParseResult in orderParseResultList:
orderItemList = orderParseResult["orderItems"]
for i, orderItem in enumerate(orderItemList):
if i == 0:
datatable.append([
orderParseResult["orderId"],
orderParseResult["paymentTime"],
orderParseResult["status"],
orderParseResult["orderTotalAmount"],
orderItem["productId"],
orderItem["productName"]
])
else:
datatable.append([
"",
"",
"",
"",
orderItem["productId"],
orderItem["productName"]
])
return datatable
def writeDatatableIntoFile(self, filename, datatable):
# file_dic = os.path.join(self.data_dir, "./jd/")
file_dic = os.path.join(self.data_dir)
if not os.path.exists(file_dic):
os.mkdir(file_dic)
with open(os.path.join(file_dic+filename), "w+") as f:
for row in datatable:
rowdata = ",".join([str(tmp).replace(",","") for tmp in row])
f.write(rowdata+"\n")
#############################################################################
if __name__ == '__main__':
cookie = 'shshshfpa=7da97119-ca02-a4b5-f883-70bffbb95d2d-1551953689; shshshfpb=oMWkS2uhzSRpZkjikQcMliQ%3D%3D; PCSYCityID=904; areaId=12; ipLoc-djd=12-965-967-38496; user-key=c2b0ef35-0281-4be2-bcf4-4148cb7f518c; sid=509cf3bcff856462fbf0d27defc956e5; __jdu=1551953690075275239163; cn=2; mt_xid=V2_52007VwMWVl1QVlgYQRhdA2MAFFZeWlpaGEspCAFjA0ZUXVBODx4cG0AAMlRFTlVQAA0DHB8MUDJQEAdcXgdTL0oYXA17AhdOXlBDWRxCHV0OZQUiUm1YYlgYTRFeAGYDGmJfXFNf; TrackID=15Z7AWYzc3eAvMsE9Og3XV9Vqvs8o3ajKGACHAWtDTYe7ivuULPCSkMo9tWJS9lHXwCZ8LdfUDyXQ3mWG_bQVpmsyOSMbH2Pp27E7FkLg140GREw3XL6HXu6C6fcCcMXL; __jda=122270672.1551953690075275239163.1551953690.1556614926.1557023684.18; __jdc=122270672; __jdv=122270672|baidu|-|organic|not set|1557023684472; shshshfp=4e62136f3f0d1f33c8191339402dd3a2; thor=BF23B370DD491EEE15CB4D3DBB29B61D6F15B23D58582409C58B0131D8A52E7B2A06114EC2F615519BB1B4EF9CC199A07E6CE4B2E82A125954D7C292D5F544DE013BB9CC77B3B4756CB9125C1021395832FFA1913E13F06D3D1F9ACF727A228E96D03B8E2FFAED7952795D7D31A24E79D58C916331895A6F660C9D84B083319A88C75EED9A114DC7D913A8DD9F83A466; pinId=PFNaS1XmeXF9TBCvJEIlnw; pin=18621759441_p; unick=jd_Miss+Vivi; ceshi3.com=000; _tp=s3iKj%2BxpTSF0rzuw4y6G4g%3D%3D; _pst=18621759441_p; shshshsID=a2fc2b444f7cc5ec786568326575de27_2_1557023849318; 3AB9D23F7A4B3C9B=Z2QEKJIHVKXOC2JNFZIJKKVZ5XVWWIJWQ5TRJ7BOO4K45QVTUZKRK4WXVBSIP5WQ7ZQYP22ZTJWGQILVDNH7G7QGDA; __jdb=122270672.6.1551953690075275239163|18.1557023684'
spider = JSpider(cookie)
# test
'''
with open("jd.txt", "r", encoding="utf8") as f:
htmlcontent = f.read()
spider.parseOnePageOrder(htmlcontent)
'''
'''
#with open("normal_item_action_ori.html", "r", encoding="utf8") as f:
with open("chongzhi_order_autoDetail_action_ori.html", "r", encoding="utf8") as f:
htmlcontent = f.read()
orderParseResult = spider.getOrderOfChongzhi(None, htmlcontent)
datatable = spider.changeOrderParseResultListToTable([orderParseResult])
spider.writeDatatableIntoFile(os.path.join(spider.data_dir, "allOrders.csv"), datatable)
'''
# spider.get_orders()
# spider.get_creditData()
# spider.get_browseDataNew()
# spider.get_income()
# spider.get_user_info()
# spider.get_addr()
# spider.get_YHK()
# spider.get_xjk_info()
# spider.get_finance_income()
# spider.get_GB_num()
# spider.get_JY_bill()
# spider.get_follow_shops()
# spider.get_follow_products()
# spider.get_cart()
================================================
FILE: Spiders/__init__.py
================================================
================================================
FILE: Spiders/alipay/main.py
================================================
import json
import os
import re
import os
import requests
from lxml import etree
from selenium import webdriver
from selenium.webdriver import ChromeOptions
from tkinter.filedialog import askdirectory
from tqdm import tqdm
class ASpider(object):
def __init__(self, cookie):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
'referer': ''
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except Exception:
pass
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
def get_user_info(self):
url = 'https://custweb.alipay.com/account/index.htm'
resp = self.session.get(url)
obj = etree.HTML(resp.content.decode()).xpath('//tbody')[0]
item = {}
item['name'] = ''.join(obj.xpath('./tr[1]/td[1]//text()')).strip()
item['email'] = ''.join(obj.xpath('./tr[2]/td[1]//text()')).strip()
item['mobile'] = ''.join(obj.xpath('./tr[3]/td[1]//text()')).strip()
item['tb_name'] = ''.join(obj.xpath('./tr[4]/td[1]//text()')).strip()
item['register_time'] = ''.join(obj.xpath('./tr[7]/td[1]//text()')).strip()
self.write_json(self.path + os.sep + 'user_info.json', json.dumps(item))
def write_json(self, name, str):
# file_path = os.path.join(os.path.dirname(__file__) + '/' + name)
with open(name, 'w') as f:
f.write(str)
def get_YEB(self):
url = 'https://yebprod.alipay.com/yeb/asset.htm'
resp = self.session.get(url)
ele = etree.HTML(resp.content.decode('gbk'))
item = {}
# print(etree.tostring(ele))
item['eye-val'] = re.sub('\s', '', ele.xpath('.//span[@class="eye-val"]/text()')[0])
item['total_val'] = re.sub('\s', '', ele.xpath('.//div[@class="box-bill-foot-account eye-val"]/text()')[0])
item['Unavailable_val'] = re.sub('\s', '', ele.xpath('.//div[@class="box-bill-foot-account eye-val"]/text()')[1])
self.write_json(self.path + os.sep + 'yu_e_bao.json', json.dumps(item))
def get_bills(self):
url = 'https://lab.alipay.com/consume/record/items.htm'
self.headers['referer'] = 'https://my.alipay.com/portal/i.htm'
resp = self.session.get(url, headers=self.headers, verify=False)
obj_list = etree.HTML(resp.content.decode('gbk')).xpath('//tbody/tr')
json_list = []
for obj in tqdm(obj_list):
item = {}
item['number'] = ''.join(obj.xpath('./td[1]//text()')).strip()
item['time'] = ''.join(obj.xpath('./td[2]//text()')).strip()
item['info'] = ''.join(obj.xpath('./td[3]//text()')).strip()
item['income'] = ''.join(obj.xpath('./td[4]//text()')).strip()
item['outcome'] = ''.join(obj.xpath('./td[5]//text()')).strip()
item['balance'] = ''.join(obj.xpath('./td[6]//text()')).strip()
item['from'] = ''.join(obj.xpath('./td[7]//text()')).strip()
item['detail'] = ''.join(obj.xpath('./td[8]//text()')).strip()
json_list.append(item)
ye = ''.join(obj_list[0].xpath('./td[6]//text()')).strip()
ye_dict = {'YuE': ye}
self.write_json(self.path + os.sep + 'bill_list.json', json.dumps(json_list))
self.write_json(self.path + os.sep + 'balance.json', json.dumps(ye_dict))
if __name__ == '__main__':
cookie = 'cna=FMHmFL1zqnUCASQH4bAneyUf; mobileSendTime=-1; credibleMobileSendTime=-1; ctuMobileSendTime=-1; riskMobileBankSendTime=-1; riskMobileAccoutSendTime=-1; riskMobileCreditSendTime=-1; riskCredibleMobileSendTime=-1; riskOriginalAccountMobileSendTime=-1; isg=BMTEs6f5RNVXdvCZiIUsYWqLlUR2dekgISd1n95lQQ9SCWTTBu-t19yoSeF0FCCf; l=bBgcZ5c7vJ2Of-mJBOCwCuI8L179_IRYSuPRwCmXi_5pZ6T68E7Olorn_F96Vj5Rs4TB4UJxb0v9-etXw; UM_distinctid=169b3c04ea8509-063bdd824c9e64-12306d51-fa000-169b3c04ea95a8; unicard1.vm="K1iSL1mnW5fEFTtXnTWZPQ=="; NEW_ALIPAY_TIP=1; csrfToken=M_AdqLObk41r9VvTDoRdyy2Q; CLUB_ALIPAY_COM=2088022680005311; iw.userid="K1iSL1mnW5fEFTtXnTWZPQ=="; ali_apache_tracktmp="uid=2088022680005311"; session.cookieNameId=ALIPAYJSESSIONID; LoginForm=alipay_login_auth; alipay="K1iSL1mnW5fEFTtXnTWZPca48DVsXJKl1U07jLnVskUcfw=="; spanner=hWXgcY78eHIkRX5btAjBSJV5G91m2+NMXt2T4qEYgj0=; locale=zh-cn; CHAIR_SESS=JWYmdXvINYrjfJhNfnAOApEy7drxxpERpaBXObg17RYQr9jGJZDWNQuk7GTZ-NeYuRSIYTsU7tiaFoLpKJpwTQ2FZqKmOSphZ98CHxZicmK3XOz8tgVdDWKxbBKLiiY4Tk4zkLNOIkCMlfoY4vOsGvxtikpzFXx61uyLzy-_-PGsZT1UzN0CDKSYTq1xRxaYhfp7vURB4eAzWjJpQXXmxXDq8A8cqmAyErsLtLBG8MfxigkVOwR88J5o95xQFcJ0; ctoken=QwetGqWKOjvvPRGx; zone=GZ00D; ALIPAYJSESSIONID=RZ257CXtTz7r7Ra0sc4QHeC4nrz1eyauthRZ25GZ00; rtk=umvDaVnzeH3Uz7V5rmCCnDE+MOkI1ZKNRTuJzmidxn8p1ZcI5EA'
spider = ASpider(cookie)
spider.get_bills()
spider.get_user_info()
spider.get_YEB()
================================================
FILE: Spiders/bilibili/main.py
================================================
import os
import json
import time
import requests
from tkinter.filedialog import askdirectory
class BilibiliHistory(object):
def __init__(self, cookie_str):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.MAX_PAGE = 10
self.PAGE_PER_NUM = 200
self.cookie = cookie_str
self.history = self.get_all_bili_history()
self.save(self.history, 'bilibili_history.json')
self.userinfo = self.get_user_info()
self.save(self.userinfo, 'user_info.json')
def get_all_bili_history(self):
headers = self.get_header()
# history = {'all': []}
history = []
for page_num in range(self.MAX_PAGE):
url = 'https://api.bilibili.com/x/v2/history?pn={pn}&ps={ps}&jsonp=jsonp'.format(pn=page_num, ps=self.PAGE_PER_NUM)
result = self.req_get(headers, url)
# print('page = {} code = {} datalen = {}'.format(page_num, result['code'], len(result['data'])))
print('爬取中...')
time.sleep(1)
# if len(result['data']) == 0:
if not result['data']:
print('爬取完成...')
break
# if page_num == 2:
# break
history.append(result)
return history
def get_user_info(self):
headers = self.get_header()
url = 'https://api.bilibili.com/x/member/web/account'
result = self.req_get(headers, url)
return result
def req_get(self, headers, url):
resp = requests.get(url, headers=headers)
return json.loads(resp.text)
def save(self, data, filename):
with open(self.path + os.sep + filename, 'w', encoding='utf-8') as fp:
json.dump(data, fp, ensure_ascii=False)
return True
def get_header(self):
headers = {
'Accept': '*/*',
'Accept-Encoding': 'gzip, deflate, br',
'Accept-Language': 'zh-CN,zh;q=0.9,en-US;q=0.8,en;q=0.7',
'Connection': 'keep-alive',
'Cookie': self.cookie,
'Host': 'api.bilibili.com',
'Referer': 'https://www.bilibili.com/account/history',
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 '
'(KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36'
}
return headers
================================================
FILE: Spiders/browser/main.py
================================================
#!/usr/bin/env python
# -*- coding: UTF-8 -*-
import os
import sys
import json
import time
import sqlite3
import operator
from collections import OrderedDict
import matplotlib.pyplot as plt
from tkinter.filedialog import askdirectory
from tqdm import tqdm
class Browserhistory(object):
def __init__(self):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
#path to user's history database (Chrome)
self.data_path=os.path.expanduser('~') + r"\AppData\Local\Google\Chrome\User Data\Default"
self.history_db=os.path.join(self.data_path,'history')
#querying the db
c = sqlite3.connect(self.history_db)
cursor = c.cursor()
select_statement = "SELECT urls.id, urls.url, urls.title, urls.visit_count, urls.last_visit_time, visits.visit_time, visits.visit_duration FROM urls, visits WHERE urls.id = visits.url;"
cursor.execute(select_statement)
self.results = cursor.fetchall() #tuple
self.data_save_as_json(self.results)
# transfer timestamp format
def timestamp_format(self, timestamp):
if timestamp > 13000000000000000:
time_c = timestamp/1000000-11644473600
return time.strftime("%Y-%m-%d %X", time.localtime(time_c))
else:
return timestamp
# transfer to json and save to file.
def data_save_as_json(self, data):
history_list = []
for i in tqdm(data):
item = {}
item['urls.id'] = i[0]
item['urls.url'] = i[1]
item['urls.title'] = i[2]
item['urls.visit_count'] = i[3]
item['urls.last_visit_time'] = self.timestamp_format(i[4])
item['visits.visit_time'] = self.timestamp_format(i[5])
item['visits.visit_duration'] = self.timestamp_format(i[6])
history_list.append(item)
history_json = json.dumps(history_list, ensure_ascii=False)
with open(self.path + '/browser_data.json', 'w', encoding='utf-8') as f:
f.write(history_json)
================================================
FILE: Spiders/chsi/main.py
================================================
import json
import os
import re
import requests
from lxml import etree
class Chis(object):
def __init__(self, cookie):
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
# 学籍信息
def get_xueji_info(self):
url = 'https://my.chsi.com.cn/archive/gdjy/xj/show.action'
resp = self.session.get(url, headers=self.headers, verify=False)
ele = etree.HTML(resp.content.decode())
try:
pic_path = ele.xpath('//img[@alt="录取照片"]/@src')[0]
if ("no-photo" in pic_path):
pic_1_url = pic_path
else:
pic_1_url = 'https://my.chsi.com.cn' + ele.xpath('//img[@alt="录取照片"]/@src')[0]
except Exception:
pic_1_url = None
pass
try:
pic_path = ele.xpath('//img[@alt="学历照片"]/@src')[0]
if ("no-photo" in pic_path):
pic_2_url = pic_path
else:
pic_2_url = 'https://my.chsi.com.cn' + ele.xpath('//img[@alt="学历照片"]/@src')[0]
except Exception:
pic_2_url = None
pass
try:
xueji_pic_url = ele.xpath('//img[@class="xjxx-img"]/@src')[0]
except Exception:
xueji_pic_url = None
return pic_1_url, pic_2_url, xueji_pic_url
# 报告
def get_report(self):
url = 'https://my.chsi.com.cn/archive/bab/index.action'
resp = self.session.get(url, verify=False)
report_detail_url = etree.HTML(resp.content.decode()).xpath('//a[@class="green-btn mid-btn marginr20"]/@href')[
0]
detail_resp = self.session.get(report_detail_url, headers=self.headers, verify=False)
report_detail_url = etree.HTML(detail_resp.content.decode()).xpath('//a[text()="查看"]/@href')[0]
resp = self.session.get(report_detail_url, headers=self.headers, verify=False)
ele = etree.HTML(resp.content.decode())
if '请输入验证码以继续当前操作:' in resp.content.decode():
ret = ele.xpath('//td[@class="tdRight"]')[1]
capt_url = 'https://www.chsi.com.cn' + ret.xpath('./following-sibling::td[1]/img/@src')[0]
value = ret.xpath('./following-sibling::td[1]/input/@value')[0]
num = re.findall(r'cap=(\d{4})', capt_url)
data = {'cap': num,
'capachatok': value,
'Submit': ' 继续'}
self.session.post('https://www.chsi.com.cn/xlcx/yzm.do', data=data)
resp = self.session.get(report_detail_url, verify=False)
ele = resp.content.decode()
pdf_url = 'https://www.chsi.com.cn' + ele.xpath('//a[@title="下载"]/@href')[0]
item = {}
item['name_url'] = 'https://www.chsi.com.cn' + \
ele.xpath('//td[@class="title1"]/following-sibling::td[1]/img/@src')[0]
print(ele.xpath('//div[@class="cnt1"]/text()'))
try:
item['genre'] = ele.xpath('//div[@class="cnt1"]/text()')[0]
except Exception:
pass
try:
item['sfz_id'] = ele.xpath('//div[@class="cnt1"]/text()')[1]
except Exception:
pass
try:
item['nation'] = ele.xpath('//div[@class="cnt1"]/text()')[2]
except Exception:
pass
try:
item['birth'] = ele.xpath('//div[@class="cnt1"]/text()')[3]
except Exception:
pass
try:
item['school'] = ele.xpath('//div[@class="cnt1"]/text()')[4]
except Exception:
pass
try:
item['education'] = ele.xpath('//div[@class="cnt1"]/text()')[5]
except Exception:
pass
try:
item['faculty'] = ele.xpath('//div[@class="cnt1"]/text()')[6]
except Exception:
pass
try:
item['class'] = ele.xpath('//div[@class="cnt1"]/text()')[7]
except Exception:
pass
try:
item['major'] = ele.xpath('//div[@class="cnt1"]/text()')[8]
except Exception:
pass
try:
item['student_id'] = ele.xpath('//div[@class="cnt1"]/text()')[9]
except Exception:
pass
try:
item['style'] = ele.xpath('//div[@class="cnt1"]/text()')[10]
except Exception:
pass
try:
item['entrance_time'] = ele.xpath('//div[@class="cnt1"]/text()')[11]
except Exception:
pass
try:
item['duration'] = ele.xpath('//div[@class="cnt1"]/text()')[12]
except Exception:
pass
try:
item['education_style'] = ele.xpath('//div[@class="cnt1"]/text()')[13]
except Exception:
pass
try:
item['status'] = ele.xpath('//div[@class="cnt1"]/text()')[14]
except Exception:
pass
ret = json.dumps(item)
file_path = os.path.join(os.path.dirname(__file__) + '/info.json')
with open(file_path, 'w') as f:
f.write(ret)
return pdf_url
def save_ret(self, url, name):
if url == None:
return
resp = self.session.get(url, verify=False)
file_path = os.path.join(os.path.dirname(__file__) + '/' + name)
with open(file_path, 'wb') as f:
f.write(resp.content)
if __name__ == '__main__':
# chis = Chis()
# p1, p2, x = chis.get_xueji_info()
# chis.save_ret(p1, '录取前照片.jpg')
# chis.save_ret(p2, '学籍照片.jpg')
# chis.save_ret(x, '学信网信息.jpg')
# p3 = chis.get_report()
# chis.save_ret(p3, '学信报告.pdf')
pass
================================================
FILE: Spiders/cloudmusic/main.py
================================================
import requests
import json
import re
import time
from tkinter.filedialog import askdirectory
class Cloudmusic(object):
def __init__(self, username, password):
self.path = askdirectory(title='选择信息保存文件夹')
self.username = username
self.password = password
self.api = 'http://45.129.2.73:3000'
self.isphone = re.compile(r'[1][^1269]\d{9}')
self.isemail = re.compile(r'[^\._][\w\._-]+@(?:[A-Za-z0-9]+\.)+[A-Za-z]+$')
self.login_refresh()
if self.isphone.match(self.username):
self.userid = str(self.user_login_as_cellphone())
elif self.isemail.match(self.username):
self.userid = str(self.user_login_as_email())
else:
print('登录失败!用户名需为手机号码或者邮箱。')
## 刷新登录状态
def login_refresh(self):
url = self.api + '/login/refresh'
response = requests.get(url)
return 0
## 使用‘手机号码’ + ‘密码’ 登录网易云音乐
def user_login_as_cellphone(self):
url = self.api + '/login/cellphone?phone=' + self.username + '&password=' + self.password
response = requests.get(url)
code = response.json()['code']
if str(200) == "200":
print('登录成功')
else:
print('登录失败')
userid = response.json()['account']['id']
# print('userid = ' + str(userid))
return userid
## 使用 ‘邮箱’ + ‘密码’ 登录网易云音乐
def user_login_as_email(self):
url = self.api + '/login?email=' + self.username + '&password=' + self.password
response = requests.get(url)
code = response.json()['code']
if str(200) == "200":
print('登录成功')
else:
print('登录失败')
userid = response.json()['account']['id']
# print('userid = ' + str(userid))
return userid
## 把获取的个人信息写入json文件
def data_wirte_to_json(self, filename, context):
filepath = self.path + '/' + filename + '.json'
with open(filepath, 'w', encoding='utf-8') as f:
f.write(context)
return filepath
## 获取用户基本信息
def get_user_detail(self):
url = self.api + '/user/detail?uid=' + self.userid
response = requests.get(url)
self.data_wirte_to_json('user_detail', response.text)
print('获取用户基本信息成功!')
return 0
## 获取用户歌单
def get_playlist(self):
url = self.api + '/user/playlist?uid=' + self.userid
response = requests.get(url)
self.data_wirte_to_json('user_playlist', response.text)
print('获取用户歌单成功!')
return 0
## 获取用户关注列表
def get_user_follows(self):
url = self.api + '/user/follows?uid=' + self.userid
response = requests.post(url)
self.data_wirte_to_json('user_follows', response.text)
print('获取用户关注列表成功!')
return 0
## 获取用户粉丝列表
def get_user_followeds(self):
url = self.api + '/user/followeds?uid=' + self.userid
response = requests.post(url)
self.data_wirte_to_json('user_followeds', response.text)
print('获取用户粉丝列表成功!')
return 0
## 获取用户动态
def get_user_event(self):
url = self.api + '/user/event?uid=' + self.userid
response = requests.post(url)
self.data_wirte_to_json('user_event', response.text)
print('获取用户动态成功!')
return 0
## 获取用户听歌排行(周榜)
def get_user_record_week(self):
url = self.api + '/user/record?uid=' + self.userid + '&type=1'
response = requests.get(url)
self.data_wirte_to_json('user_record_week', response.text)
print('获取用户听歌排行(周榜)成功!')
return 0
## 获取用户听歌排行(总榜)
def get_user_record_all(self):
url = self.api + '/user/record?uid=' + self.userid + '&type=0'
response = requests.get(url)
self.data_wirte_to_json('user_record_all', response.text)
print('获取用户听歌排行(总榜)成功!')
return 0
if __name__ == '__main__':
music = Cloudmusic('132****', '*****')
music.get_user_detail()
music.get_playlist()
music.get_user_follows()
music.get_user_followeds()
music.get_user_event()
music.get_user_record_week()
music.get_user_record_all()
================================================
FILE: Spiders/cnblog/main.py
================================================
import re
import os
import sys
import json
import requests
import pandas as pd
import numpy as np
import jieba
import pyecharts
from pyecharts import options as opts
from collections import Counter
from pyecharts.charts import WordCloud
from pyecharts.charts import Line
from bs4 import BeautifulSoup
from tkinter.filedialog import askdirectory
class Cnblog(object):
def __init__(self, blogname):
self.blogname = blogname
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
def get_element_of_article(self):
'''
获取元素(标题,发布时间,阅读量)
'''
url = 'https://www.cnblogs.com/' + str(self.blogname) + '/default.html'
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.89 Safari/537.36'
}
pos = 1
article_list = []
while 1:
key_dict = {'page': str(pos)}
reps = requests.get(url, headers=headers, params=key_dict, timeout=3)
soup = BeautifulSoup(reps.text, "html.parser")
posts = soup.find_all("div", class_="day")
if not len(posts):
break
date_pattern = re.compile(r"\d{4}-\d{1,2}-\d{1,2}")
time_pattern = re.compile(r"\d{2}:\d{2}")
views_pattern = re.compile(r"\d+")
from tqdm import tqdm
pbar = tqdm(posts)
for each_post in pbar:
try:
item = {}
item['title'] = each_post.find("div", class_="postTitle").text.strip()
item['sumary'] = each_post.find("div", class_="c_b_p_desc").text.strip()
item['postdate'] = date_pattern.findall(each_post.find("div", class_="postDesc").text)[0]
item['posttime'] = time_pattern.findall(each_post.find("div", class_="postDesc").text)[0]
item['views'] = views_pattern.findall(each_post.find("span", class_="post-view-count").text)[0]
article_list.append(item)
pbar.set_description("正在爬取文章:%s" % item['title'])
except:
pass
import time
time.sleep(0.1)
pos += 1
article_json = json.dumps(article_list)
return article_json
def save_as_json(self, content_json):
json_file_name = self.path + os.sep + 'cnblog_article.json'
with open(json_file_name, 'w', encoding='utf-8') as f:
f.write(content_json)
return json_file_name
# 获取所有字段存为一个字符串
def get_text(self, json_file, column='title'):
df_json = pd.read_json(json_file, encoding='utf-8')
text = ''
for i in df_json[column]:
text += i
return text
# 去停用词,使用jieba分词
def split_word(self, text):
word_list = list(jieba.cut(text))
# 去掉一些无意义的词和符号,我这里自己整理了停用词库
with open('stop_word.txt', encoding='utf-8') as f:
meaningless_word = f.read().splitlines()
# print(meaningless_word)
result = []
# 筛选词语
for i in word_list:
if i not in meaningless_word:
result.append(i.replace(' ', ''))
return result
# 词频统计
def word_counter(self, words):
# 使用Count计数方法
words_counter = Counter(words)
# 将Counter类型转换为列表
words_list = words_counter.most_common(100)
return words_list
# 生成词云
def create_wordcloud(self, json_file, title='词云', column='title'):
text = self.get_text(json_file, column=column)
clear_word = self.split_word(text)
data = self.word_counter(clear_word)
wd = WordCloud()
wd.add(series_name=title, data_pair=data, word_size_range=[40, 150])
wd.set_global_opts(title_opts=opts.TitleOpts(title="你的文章词云", subtitle="基于你的博客数据生成", title_textstyle_opts=opts.TextStyleOpts(font_size=23)), tooltip_opts=opts.TooltipOpts(is_show=True))
# wd.render_notebook()
wd.render(self.path + os.sep + 'topic_wordcloud.html')
# 生成折线图
def create_postdate_line(self, json_file, title='折线图', column='postdate'):
df_json = pd.read_json(json_file, encoding='utf-8')
postdate_month_list = []
for i in df_json[column]:
postdate_month_list.append('-'.join(i.split('-')[:-1]))
date_counter = Counter(postdate_month_list)
line = Line()
x_data = [i for i in date_counter]
y_data = [date_counter[i] for i in date_counter]
line.add_xaxis(x_data)
line.add_yaxis(series_name="发文数量", y_axis=y_data)
line.set_global_opts(title_opts=opts.TitleOpts(title="你的发文数量", subtitle="基于你的博客数据生成"))
line.render(self.path + os.sep + 'postdate_line.html')
if __name__ == '__main__':
article = get_element_of_article('kangvcar')
json_file_name = save_as_json(article)
create_wordcloud(json_file_name, title='你的创作领域词云', column='title')
create_postdate_line(json_file_name, title='发文时间线', column='postdate')
================================================
FILE: Spiders/csdn/main.py
================================================
import re
import os
import sys
import json
import requests
from bs4 import BeautifulSoup
from tkinter.filedialog import askdirectory
class Csdn(object):
def __init__(self, blogname):
self.blogname = blogname
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.89 Safari/537.36'
}
def get_element_of_article(self):
'''
获取元素(标题,发布时间,阅读量)
'''
article_list = []
pos = 1
while 1:
url='https://blog.csdn.net/' + self.blogname + '/article/list/' + str(pos)
reps = requests.get(url,headers=self.headers,timeout=30)
soup = BeautifulSoup(reps.text, 'lxml')
posts = soup.findAll(name="div", attrs={"class" :"article-item-box csdn-tracking-statistics"})
if not len(posts):
break
date_pattern = re.compile(r"\d{4}-\d{1,2}-\d{1,2}")
time_pattern = re.compile(r"\d{2}:\d{2}:\d{2}")
views_pattern = re.compile(r"\d+")
from tqdm import tqdm
pbar = tqdm(posts)
for each_post in pbar:
item = {}
try:
item['title'] = each_post.find(name="h4").text.split(' ', 1)[1].strip()
item['sumary'] = each_post.find(name="p", attrs={"class": "content"}).text.strip().replace('\n', "")
item['postdate'] = date_pattern.findall(each_post.find(name="span", attrs={"class": "date"}).text.strip())[0]
item['posttime'] = time_pattern.findall(each_post.find(name="span", attrs={"class": "date"}).text.strip())[0]
item['views'] = views_pattern.findall(each_post.find(name="span", attrs={"class": "read-num"}).text)[0]
# print(item)
article_list.append(item)
pbar.set_description("正在爬取文章:%s" % item['title'])
except Exception as e:
print('异常信息:' + repr(e))
pass
import time
time.sleep(0.1)
pos += 1
article_json = json.dumps(article_list)
return article_json
def save_as_json(self, content_json):
with open(self.path + os.sep + 'csdn_article.json', 'w', encoding='utf-8') as f:
f.write(content_json)
if __name__ == '__main__':
article = get_element_of_article('kangvcar')
save_as_json(article)
================================================
FILE: Spiders/ctrip/main.py
================================================
import os
import time
import requests
import json
import xlsxwriter
class Ctrip(object):
def __init__(self, cookie):
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
def get_json_order(self):
headers = self.headers
headers['referer'] = 'https://my.ctrip.com/Home/Order/AllOrder.aspx'
url = 'https://my.ctrip.com/Home/Ajax/GetAllOrder.ashx'
sequence = int(time.time() * 10000000)
# 时间等字段可以传入
data = {
'BizTypes': '',
'BookingDateTime': '',
'BeginBookingDateTime': '',
'EndBookingDateTime': '',
'BeginUsageDateTime': '',
'EndUsageDateTime': '',
'PageSize': 10,
'PageIndex': 1,
'OrderStatusClassify': 'All',
'OrderIDs': '',
'OrderStatuses': '',
'PassengerName': '',
'OrderType': '',
'FieldName': '',
'IsASC': '',
'sequence': sequence
}
resp = self.session.post(url, headers=self.headers, data=data, verify=False)
return resp.content.decode('gbk');
def transfer_and_save(self, json_str):
json_orders = json.loads(json_str)
for key in json_orders:
if key == 'OrderEnities':
json_order_lists = json_orders[key]
book = xlsxwriter.Workbook('ctrip_order.xlsx')
sheet = book.add_worksheet()
sheet.write(0, 0, 'Date')
sheet.write(0, 1, 'OrderDetails')
sheet.write(0, 2, 'Price')
for i in range(len(json_order_lists)):
json_order = json_order_lists[i]
sheet.write(i+1, 0, json_order['BookingDate'])
sheet.write(i+1, 1, json_order['OrderName'])
sheet.write(i+1, 2, json_order['OrderTotalPrice'])
book.close()
# download orders and save them in an excel file
def get_order(self):
# get the order from the sctrip website
json_order = self.get_json_order()
# transfer the order and store it in an excel
self.transfer_and_save(json_order)
if __name__ == '__main__':
ctrip = Ctrip()
ctrip.get_order()
================================================
FILE: Spiders/github/main.py
================================================
import json
import os
import re
import requests
from tkinter.filedialog import askdirectory
class Github(object):
def __init__(self, username):
self.username = username
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
self.path = askdirectory(title='选择信息保存文件夹')
# 用户信息
def get_user_info(self):
url = 'https://api.github.com/users/' + self.username
resp = requests.get(url, headers=self.headers)
# print(resp.text)
file_path = self.path + '/user_infomation.json'
with open(file_path, 'w') as f:
f.write(resp.text.encode("gbk", 'ignore').decode("gbk", "ignore"))
return file_path
# 用户仓库信息
def get_user_repos(self):
url = 'https://api.github.com/users/' + self.username + '/repos'
resp = requests.get(url, headers=self.headers)
# print(resp.text)
file_path = self.path + '/user_repository.json'
with open(file_path, 'w') as f:
f.write(resp.text.encode("gbk", 'ignore').decode("gbk", "ignore"))
return file_path
# 用户的关注信息
def get_user_following(self):
url = 'https://api.github.com/users/' + self.username + '/following'
resp = requests.get(url, headers=self.headers)
# print(resp.text)
file_path = self.path + '/user_following.json'
with open(file_path, 'w') as f:
f.write(resp.text.encode("gbk", 'ignore').decode("gbk", "ignore"))
return file_path
# 用户的粉丝信息
def get_user_followers(self):
url = 'https://api.github.com/users/' + self.username + '/followers'
resp = requests.get(url, headers=self.headers)
# print(resp.text)
file_path = self.path + '/user_followers.json'
with open(file_path, 'w') as f:
f.write(resp.text.encode("gbk", 'ignore').decode("gbk", "ignore"))
return file_path
# 用户activity信息
def get_user_activity(self):
url = 'https://api.github.com/users/' + self.username + '/received_events'
resp = requests.get(url, headers=self.headers)
# print(resp.text)
file_path = self.path + '/user_activity.json'
with open(file_path, 'w') as f:
f.write(resp.text.encode("gbk", 'ignore').decode("gbk", "ignore"))
return file_path
# 用户所有仓库的详细信息
def get_user_repos_detail(self):
url = 'https://api.github.com/users/' + self.username + '/repos'
resp = requests.get(url, headers=self.headers, verify=False, timeout=2)
repo_detail = []
for name in resp.json():
repo_url = 'https://api.github.com/repos/' + self.username + '/' + name['name']
detail = requests.get(repo_url, headers=self.headers, verify=False, timeout=2)
repo_detail.append(detail.text.encode("gbk", 'ignore').decode("gbk", "ignore"))
print('正在下载仓库信息 >>> ', name['name'])
print(repo_detail)
file_path = self.path + '/user_all_repos_detail.json'
with open(file_path, 'w') as f:
f.write(str(repo_detail))
return file_path
if __name__ == '__main__':
github = Github('kangvcar')
github.get_user_info()
github.get_user_repos()
github.get_user_following()
github.get_user_followers()
github.get_user_activity()
github.get_user_repos_detail()
================================================
FILE: Spiders/jianshu/main.py
================================================
import re
import os
import sys
import json
import requests
from bs4 import BeautifulSoup
from tkinter.filedialog import askdirectory
class Jianshu(object):
def __init__(self, blogurl):
self.blogurl = blogurl
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.89 Safari/537.36'
}
def get_element_of_article(self):
'''
获取元素(标题,发布时间,阅读量)
'''
# url = "https://www.jianshu.com/u/d959ac37cdde?order_by=shared_at&page=1"
url = self.blogurl
pos = 1
article_list = []
while 1:
key_dict = {
'order_by': 'shared_at',
'page': str(pos),
}
reps = requests.get(url, headers=self.headers, params=key_dict, timeout=10)
soup = BeautifulSoup(reps.text, "html.parser")
posts = soup.find_all("div", class_="content")
print('=======================>>>>' + str(len(posts)))
# if not len(posts):
# break
date_pattern = re.compile(r"\d+-\d{1,2}-\d{1,2}")
time_pattern = re.compile(r"\d{2}:\d{2}")
from tqdm import tqdm
pbar = tqdm(posts)
for each_post in pbar:
try:
item = {}
item['title'] = each_post.find("a", class_="title").text.strip()
item['sumary'] = each_post.find("p", class_="abstract").text.strip()
item['postdate'] = date_pattern.findall(each_post.find("span", class_="time")['data-shared-at'])[0]
item['posttime'] = time_pattern.findall(each_post.find("span", class_="time")['data-shared-at'])[0]
item['views'] = each_post.find("div", class_="meta").find("a").text.strip()
article_list.append(item)
pbar.set_description("正在爬取文章:%s" % item['title'])
except:
pass
import time
time.sleep(0.1)
pos += 1
if len(posts) < 9:
break
article_json = json.dumps(article_list)
return article_json
def save_as_json(self, content_json):
with open(self.path + os.sep + 'jianshu_article.json', 'w', encoding='utf-8') as f:
f.write(content_json)
if __name__ == '__main__':
article = get_element_of_article('https://www.jianshu.com/u/d959ac37cdde')
save_as_json(article)
================================================
FILE: Spiders/mail/main.py
================================================
# -*- coding: utf-8 -*-
import json
import os
import re
import time
import sys
from nltk.sem.drt import DrtParser
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
from selenium import webdriver
from selenium.webdriver import ChromeOptions
import requests
from lxml import etree
from selenium.webdriver.support.wait import WebDriverWait
from tkinter.filedialog import askdirectory
class YSpider(object):
def gen_session(self, cookie):
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
def write_json(self, name, str):
# file_path = os.path.join(os.path.dirname(__file__) + '/' + name)
with open(name, 'w') as f:
f.write(str)
## 爬取QQ邮箱
def qq_mail(self, cookie, sid):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
pn = 0
self.gen_session(cookie)
while 1:
url = 'https://mail.qq.com/cgi-bin/mail_list?page={}&folderid=1&fun=&s=inbox&searchmode=&filetype=&listmode=&stype=&ftype=&AddrID=&grpid=&category=&showattachtag=&from=&sorttype=6&sortasc=0&sid={}&nocheckframe=true'.format(
pn, sid)
pn += 1
resp = self.session.get(url, headers=self.headers, verify=False)
print(resp, '>>>>>> 正在爬取第', pn, '页')
try:
etree.HTML(resp.content.decode('gbk')).xpath('//a[text()="下一页"]')[0]
except Exception:
print('Done. >>>>>> 爬取完成')
break
obj_list = etree.HTML(resp.content.decode('gbk')).xpath('//div[@id="div_showbefore"]/table')
json_list = []
# 这里修改邮箱的流量 [:100]
for obj in obj_list[:100]:
item = {}
item['send_user'] = ''.join(obj.xpath('.//td[@class="tl tf "]//text()')).strip()
try:
item['mailid'] = obj.xpath('.//td[@class="tl tf "]/nobr/@mailid')[0]
except Exception:
continue
item['title'] = ''.join(obj.xpath('.//td[@class="gt"]//text()')).strip()
item['time'] = ''.join(obj.xpath('.//td[@class="dt"]//text()')).strip()
detail_url = 'https://mail.qq.com/cgi-bin/readmail?folderid=1&folderkey=1&t=readmail&mailid={}&mode=pre&maxage=3600&base=12.52&ver=19894&sid={}&newwin=true&nocheckframe=true'.format(
item['mailid'], sid)
try:
detail_resp = etree.HTML(self.session.get(detail_url, headers=self.headers).content.decode('gbk'))
item['email_addr'] = detail_resp.xpath('//b[@id="tipFromAddr_readmail"]/@fromaddr')[0]
content = ''.join(detail_resp.xpath('//div[@id="contentDiv"]//text()'))
item['content'] = re.sub(r'[\t\n\s]', '', content)
json_list.append(item)
print('1' + item)
except Exception:
continue
if json_list == []:
time.sleep(2)
pn = pn - 1
else:
self.write_json(self.path + os.sep + 'qqmail_' + str(pn) + '.json', json.dumps(json_list))
# break
## 爬取新浪邮箱
def sinamail(self, cookie):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.gen_session(cookie)
pn = 1
url = 'https://m0.mail.sina.com.cn/wa.php?a=list_mail'
while 1:
data = {
'fid': 'new',
'order': 'htime',
'sorttype': 'desc',
'type': '0',
'pageno': str(pn),
'tag': '-1',
'webmail': '1',
}
# self.headers['Referer'] = 'https://m0.mail.sina.com.cn/classic/index.php?ssl=1'
json_data = json.loads(
self.session.post(url, headers=self.headers, data=data, verify=False).content.decode())
obj_list = json_data['data']['maillist']
if obj_list == []:
break
json_list = []
for obj in obj_list[:100]:
item = {}
item['mid'] = obj[0]
item['title'] = obj[3]
item['send_user'] = obj[1]
item['email_addr'] = obj[2]
detail_url = 'https://m0.mail.sina.com.cn/classic/readmail.php?webmail=1&fid=new&mid={}'.format(
item['mid'])
detail_resp = self.session.get(detail_url)
content_json = json.loads(detail_resp.content.decode())
item['content_json'] = content_json
json_list.append(item)
self.write_json(self.path + os.sep + 'sina_' + str(pn) + '.json', json.dumps(json_list))
pn += 1
def gen_driver(self, cookies_list):
try:
option = ChromeOptions()
option.add_experimental_option('excludeSwitches', ['enable-automation'])
option.add_experimental_option("prefs", {"profile.managed_default_content_settings.images": 2}) # 不加载图片,加快访问速度
option.add_argument('--headless')
self.driver = webdriver.Chrome(options=option)
# self.driver.get('https://outlook.live.com/mail/0/inbox')
self.driver.get('https://outlook.live.com/mail/inbox')
for i in cookies_list:
self.driver.add_cookie(cookie_dict=i)
self.driver.get('https://outlook.live.com/mail/inbox')
# self.driver.get('https://outlook.live.com/mail/0/inbox')
except Exception as e:
print(e)
## 爬取hotmail/outlook邮箱
def get_hotmail(self, cookie_list):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.gen_driver(cookie_list)
time.sleep(2)
page_source = self.driver.page_source
obj_list = etree.HTML(page_source).xpath('//div[contains(@class,"customScrollBar")]')[1].xpath('./div/div')[1:]
# obj_list = etree.HTML(page_source).xpath('//div[contains(@role,"option")]')[:]
json_list = []
i = 0
for obj in obj_list[:100]:
try:
i += 1
print('进度 >>>>>>>>>>>', i, '/' , len(obj_list))
item = {}
item['send_user'] = ''.join(obj.xpath('./div/div/div/div[2]/div[1]//text()')).strip()
#item['email_addr'] = obj.xpath('./div/div/div/div[2]/div[1]//span/@title')[0]
item['title'] = ''.join(obj.xpath('./div/div/div/div[2]/div[2]/div//text()')).strip()
item['time'] = ''.join(obj.xpath('./div/div/div/div[2]/div[2]/span//text()')).strip()
item['content'] = ''.join(obj.xpath('./div/div/div/div[2]/div[3]//text()')).strip()
json_list.append(item)
# print(item)
except Exception:
continue
self.write_json(self.path + os.sep + 'hotmail.json', json.dumps(json_list))
## 爬取阿里邮箱
def get_aliyun_mail(self, cookie):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.gen_session(cookie)
h = {
'Host': 'mail.aliyun.com',
'Origin': 'https://mail.aliyun.com',
'Referer': 'https://mail.aliyun.com/alimail/',
'User-Agent': 'Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.103 Mobile Safari/537.36'
}
csrf_token = re.findall(r'_csrf_token_=(\w+);', cookie)[0]
data = {
'showFrom': '1',
'query': '{"folderIds": ["2"]}',
'fragment': '1',
'offset': '0',
'length': '75',
'curIncrementId': '0',
'forceReturnData': '1',
'_csrf_token_': csrf_token,
'_refer_hash_': '',
'_tpl_': 'v5'
}
url = 'https://mail.aliyun.com/alimail/ajax/mail/queryMailList.txt'
resp = self.session.post(url, headers=h, data=data)
obj_list = json.loads(resp.content.decode())['dataList']
self.write_json(self.path + os.sep + 'aliyun_mail.json', json.dumps(obj_list))
## 爬取网易邮箱
def get_wangyi(self, cookie):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.gen_session(cookie)
offset = 0
while 1:
sid = re.findall('sid=(\w*);?', cookie)[0]
data = {
'var': '{} true true true true A A A A true '.format(
sid)
}
list_url = 'https://mail.126.com/js6/s?sid={}&func=mbox:listMessages'.format(sid)
self.headers['Referer'] = 'https://mail.126.com/js6/main.jsp?sid={}&df=mail126_letter'.format(sid)
self.headers['Host'] = 'mail.126.com'
self.headers['Origin'] = 'https://mail.126.com'
# 可以定义抓多页,由0决定从哪里开始抓 每页20
list_data = {
'var': '1 date true 20 {} false top true true '.format(offset)}
list_resp = self.session.post(list_url, data=list_data, headers=self.headers)
try:
xml = list_resp.content.decode()
result = Xml2Json(xml).result
obj_list = result['result']['array']['object']
except:
print('Done. >>>>>> 爬取完成')
break
json_list = []
for obj in obj_list[:100]:
item = {}
item['mid'] = obj['string'][0]
item['send_user'] = obj['string'][3]
item['time'] = obj['date'][0]
read_data = {
'var': '{} true true true true A A A A true '.format(
item['mid'])}
# url = 'https://mail.126.com/js6/s?sid={}&func=mbox:readMessage&l=read&action=read'.format(sid)
h = self.headers
h['Referer'] = 'https://mail.126.com/js6/main.jsp?sid={}&df=mail126_letter'.format(sid)
url = 'https://mail.126.com/js6/read/readhtml.jsp?mid={}&userType=browser&font=15&color=138144'.format(
item['mid'])
read_resp = self.session.get(url, headers=h).content.decode()
item['content'] = read_resp
json_list.append(item)
offset += 20
self.write_json(self.path + os.sep + 'wangyiemail_' + str(offset) + '.json', json.dumps(json_list))
print('>>>>>> 已爬取', offset , '封邮件')
from xml.parsers.expat import ParserCreate
import json
class Xml2Json:
LIST_TAGS = ['COMMANDS']
def __init__(self, data=None):
self._parser = ParserCreate()
self._parser.StartElementHandler = self.start
self._parser.EndElementHandler = self.end
self._parser.CharacterDataHandler = self.data
self.result = None
if data:
self.feed(data)
self.close()
def feed(self, data):
self._stack = []
self._data = ''
self._parser.Parse(data, 0)
def close(self):
self._parser.Parse("", 1)
del self._parser
def start(self, tag, attrs):
self._stack.append([tag])
self._data = ''
def end(self, tag):
last_tag = self._stack.pop()
assert last_tag[0] == tag
if len(last_tag) == 1: # leaf
data = self._data
else:
if tag not in Xml2Json.LIST_TAGS:
# build a dict, repeating pairs get pushed into lists
data = {}
for k, v in last_tag[1:]:
if k not in data:
data[k] = v
else:
el = data[k]
if type(el) is not list:
data[k] = [el, v]
else:
el.append(v)
else: # force into a list
data = [{k: v} for k, v in last_tag[1:]]
if self._stack:
self._stack[-1].append((tag, data))
else:
self.result = {tag: data}
self._data = ''
def data(self, data):
self._data = data
if __name__ == '__main__':
pass
# spider = YSpider()
# cookie = 'RK=08INbKKteB; ptcz=34d123f5e73461008137394d19e04d60eab830a92bf41185d4f0182ee61a5521; pgv_pvid=4059846466; pgv_pvi=5613933568; tvfe_boss_uuid=992d9d744425918e; webp=1; sd_userid=98621550112504200; sd_cookie_crttime=1550112504200; o_cookie=1730116525; pac_uid=1_1730116525; ptui_loginuin=1730116525; qm_logintype=qq; edition=mail.qq.com; CCSHOW=000001; 3g_guest_id=-8633798135484776448; g_ut=2; pgv_si=s2145654784; ptisp=ctc; uin=o1730116525; p_uin=o1730116525; pt4_token=81P7iG1*AxAfGK4Jh0NRIlDerWaPnA5Ko3w7uaGk3PQ_; p_skey=ZsjlPkYlhysIUMXK0VG4o8KiWjdpwr4TSI6tcwdKd1Y_; wimrefreshrun=0&; qm_flag=0; qqmail_alias=1730116525@qq.com; sid=1730116525&a95f77b18430b21508bf8172132d2825,qWnNqbFBrWWxoeXNJVU1YSzBWRzRvOEtpV2pkcHdyNFRTSTZ0Y3dkS2QxWV8.; qm_username=1730116525; qm_domain=https://mail.qq.com; qm_ptsk=1730116525&@258wSqE3j; foxacc=1730116525&0; ssl_edition=sail.qq.com; username=1730116525&1730116525; qm_loginfrom=1730116525&wsk; new_mail_num=1730116525&237'
# spider.qq_mail(cookie, sid='f9IbK1BLIzz5dRJO')
# cookie = 'UOR=www.baidu.com,news.sina.com.cn,; SINAGLOBAL=122.194.13.97_1549887611.612474; U_TRS1=0000005f.8784126e.5c77a12a.6d4ae99c; SCF=AsFpDw15-joK8PaLwQ3zWw2EWY_LdjhaNMylkzKfpZelPwEBzKyQOAaYOfr72Bg_PCXfYEuYul3ugGHuCwhuBAs.; sso_info=v02m6alo5qztKWRk5yljpOQpZCToKWRk5iljoOgpZCjnLKNo5y3jaOMsY2DkLeJp5WpmYO0so2jnLeNo4yxjYOQtw==; ustat=__10.13.32.188_1553167729_0.51711200; vjuids=-82bcc10fb.169a38c601a.0.1bc3711c68cde; SGUID=1553676522217_12459803; lxlrttp=1554343419; U_TRS2=00000098.64c47105.5cc54e22.9e1054fd; SUB=_2A25xwT5mDeRhGeRI7FUX8y_IzzuIHXVStyiurDV_PUNbm9BeLW3skW9NUptz-3GnQYMi1TEeZF9ultH9I7fS80cx; SUBP=0033WrSXqPxfM725Ws9jqgMF55529P9D9WWrC_-Qw58znOpZVBddy.Te5NHD95QESoMNSoepShBNWs4Dqcjki--NiKy8iKn4i--fiKnfi-8hi--fi-82iK.7eK.4S7tt; ALF=1587970486; SWEBAPPSESSID=804320c62b770407bedab26616660c15f; CNZZDATA1261017783=860035498-1556432811-https%253A%252F%252Fmail.sina.com.cn%252F%7C1556432811; ULV=1556434495403:12:12:1::1556368966985; vjlast=1556434496; Apache=117.89.130.152_1556434495.729703; UM_distinctid=16a62ba4e6e6fc-0f9c50fa34410f-366e7e04-fa000-16a62ba4e6f6e1'
# spider.sinamail(cookie)
# cookie_list = json.loads(open('hotmail_cookies.json', 'r').read())
# spider.get_aliyun_mail(cookie_list)
# cookie = 'mail_health_check_time=1556501715894; starttime=; NTES_SESS=ini82ivtgl5wDI9_Y1knW14X.sTNHeHCLrAOfbOx.nna.6Js.4TFkUJpu9Az4LPUrfLKuM2jfSagfBxCqw6IA9gWzY5Njp0q9.671F7eJlDfRMqjbkJQO.uNEVYPyYMbDZjKSPEU_oCYZb8JPVteqp3Op8jF8Bc9JyIYISD7VfAQO9t86CatY1GPy36HvWikQULzz4muAFLAfI.YVjjrn99oq; S_INFO=1556501710|0|#3&80#|xyuniv@126.com; P_INFO=xyuniv@126.com|1556501710|0|mail126|00&99|US&1556463693&mail126#jis&320100#10#0#0|&0|mail126|xyuniv@126.com; nts_mail_user=xyuniv@126.com:-1:1; df=mail126_letter; mail_upx=t7hz.mail.126.com|t8hz.mail.126.com|t10hz.mail.126.com|t11hz.mail.126.com|t12hz.mail.126.com|t13hz.mail.126.com|t1hz.mail.126.com|t2hz.mail.126.com|t3hz.mail.126.com|t4hz.mail.126.com|t5hz.mail.126.com|t6hz.mail.126.com|t2bj.mail.126.com|t3bj.mail.126.com|t4bj.mail.126.com|t1bj.mail.126.com; mail_upx_nf=; mail_idc=; Coremail=194afc42dbf23%aAfbaxmmifMELLVPhOmmnqQaQXelGTBw%g3a24.mail.126.com; MAIL_MISC=xyuniv@126.com; cm_last_info=dT14eXVuaXYlNDAxMjYuY29tJmQ9aHR0cHMlM0ElMkYlMkZtYWlsLjEyNi5jb20lMkZqczYlMkZtYWluLmpzcCUzRnNpZCUzRGFBZmJheG1taWZNRUxMVlBoT21tbnFRYVFYZWxHVEJ3JnM9YUFmYmF4bW1pZk1FTExWUGhPbW1ucVFhUVhlbEdUQncmaD1odHRwcyUzQSUyRiUyRm1haWwuMTI2LmNvbSUyRmpzNiUyRm1haW4uanNwJTNGc2lkJTNEYUFmYmF4bW1pZk1FTExWUGhPbW1ucVFhUVhlbEdUQncmdz1odHRwcyUzQSUyRiUyRm1haWwuMTI2LmNvbSZsPS0xJnQ9LTEmYXM9dHJ1ZQ==; MAIL_SESS=ini82ivtgl5wDI9_Y1knW14X.sTNHeHCLrAOfbOx.nna.6Js.4TFkUJpu9Az4LPUrfLKuM2jfSagfBxCqw6IA9gWzY5Njp0q9.671F7eJlDfRMqjbkJQO.uNEVYPyYMbDZjKSPEU_oCYZb8JPVteqp3Op8jF8Bc9JyIYISD7VfAQO9t86CatY1GPy36HvWikQULzz4muAFLAfI.YVjjrn99oq; MAIL_SINFO=1556501710|0|#3&80#|xyuniv@126.com; MAIL_PINFO=xyuniv@126.com|1556501710|0|mail126|00&99|US&1556463693&mail126#jis&320100#10#0#0|&0|mail126|xyuniv@126.com; secu_info=1; mail_entry_sess=3bc519a600911b098d78381ef8e6496bf734b21965426384dd61eae13ccc567ce412b1a4d87268001a48b97d8e70360ff343a82d20bd63fc25ff3e45acefc7292f5726bc6964dc4b7f2b42205d34b857517fb04c5422155c9ced393fd3ae6338cdc5cbddc01366a4c4a25ef1d85ca2631bf42257cbc16917784d7545e3da13d78c0372063cd303a58b6aa028f6b3439a1620f8e4495d62706441f4bb25efddf603dbf9920f56eeea8daf407a4dc56e5b32966b7f224c0aafed33abb477a6bef8; JSESSIONID=893C397F90ED296D5B0A1D2BC36E9CB4; locale=; Coremail.sid=aAfbaxmmifMELLVPhOmmnqQaQXelGTBw; mail_style=js6; mail_uid=xyuniv@126.com; mail_host=mail.126.com'
# spider.get_wangyi(cookie)
# cookie = 'cna=FMHmFL1zqnUCASQH4bAneyUf; UM_distinctid=168e59f5374dd-0ffb4e388c2c9a-10316653-fa000-168e59f537912c; _ga=GA1.2.1733390193.1551330586; login_aliyunid_pk=1088681173604737; cnz=mbAIFT9WETACAbRtUGeqBwig; CLOSE_HELP_GUIDE=true; CONSOLE_TOPBAR_HIDE_CLOUDSHELL_TIPS=true; aliyun_choice=CN; aliyun_lang=zh; consoleRecentVisit=dms%2Cram%2Crds%2Cecs%2Cdns%2Cdomain; login_aliyunid_pks="BG+D8tiW5/jEgYGyPFZ3Z6jSLutdLxhnJnTZEOtwuKXDfw="; aliyun_country=CN; aliyun_site=CN; alimail_init_lang=zh_CN; alimail_browser_instance=dC03ODUxLTA5QzZQZg9411; alimail_sid=5F666U81-IX15ENGAYURMR38AR6RT2-WLQXT1VJ-GQ2; alimail_sdata0=a24zos5gOAbHitWQr5w%2FAD5E6xiiDmys%2B8hqW0CFvR7q7SBZ9K8RFSdHXC%2BJz1FyZZC5X7Zx9op7Qx5yNINzLXr5t2qBzTvVR1XOrEwxnPQ3CLpUmTHiHh2MpNcc53O8P1s8YPq6Pg18%2FNs2zcdmSw%3D%3D; CNZZDATA1254123247=1911432078-1556435554-null%7C1556506558; alimail_session_version_key=5548646; alimail_havana_session_key=QXltU2Vzc2lvbi0xMzg4MC1TUDVHUWlMOWd5NWl2bWRPT0ZoV1lNcnVRZ2IxV1FvREZHWGpWV2JiVmhSSUhnSEp1Qg; havana_session_id=1pCziS2gjiClEfHzQWUp0QQ1; alimail_auth_session_key=QXltU2Vzc2lvbi0xMzg4MS1kdDZNZ1hqaDdEOUdBM2RGSnFlREpRZXZwMDVGckFuaHM1cVJvQWpjSnJEZ1BkV1pabg; at="bluetips@aliyun.comTa0T71556438729180"; alimail_session_template_key=v5; isg=BAwMTLR4vJkU_aii11pxUIbk3Wz-7bKiWEki1WbNGbda8az7jlesfkRAlbnvjehH; l=bBaK1Kxmvo81eqs1BOCwRuI8UN2esIRvmuPRwdfHiOCH6A89CrT2AJBwSpNeVNKp7_CM4etPE4c11dLHRnOR.; CNZZDATA1000081634=1612451355-1556433941-https%253A%252F%252Fmail.aliyun.com%252F%7C1556509041; _csrf_token_=QXltVG9rZW4tMTkzODk5LTBCZHcycHFpWUZYR2RVd21LNFVoR1NXaU5XRlVnRnVFdldiSmNCSUtMVHJyTHJJT1dO; havana_heart_beat=1556510268875; udtoken="bluetips@aliyun.com:3db75983fca1c1b9df8d0e55d4ccbf03:5018131556510269033182"'
# spider.get_aliyun_mail(cookie)
# spider.get_hotmail(cookie_list)
================================================
FILE: Spiders/moments_album/main.py
================================================
# -*- coding:utf-8 -*-
from selenium import webdriver
import selenium.webdriver.support.expected_conditions as EC
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from platform import system
import time
import json
import os
import sys
import random
from tkinter.filedialog import askdirectory
class Momentsablum(object):
def __init__(self):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
# 以网页输入文本框形式提示用户输入url地址
def input_url(self, driver):
while(True):
# js脚本
random_id = [str(random.randint(0, 9)) for i in range(0,10)]
random_id = "".join(random_id)
random_id = 'id_input_target_url_' + random_id
js = """
// 弹出文本输入框,输入微信书的完整链接地址
target_url = prompt("请输入微信书的完整链接地址","https://");
// 动态创建一个input元素
input_target_url = document.createElement("input");
// 为其设置id,以便在程序中能够获取到它的值
input_target_url.id = "id_input_target_url";
// 插入到当前网页中
document.getElementsByTagName("body")[0].appendChild(input_target_url);
// 设置不可见
document.getElementById("id_input_target_url").style.display = 'none';
// 设置value为target_url的值
document.getElementById("id_input_target_url").value = target_url
"""
js = js.replace('id_input_target_url', random_id)
# 执行以上js脚本
driver.execute_script(js)
# 判断弹出框是否存在
while(True):
try:
# 检测是否存在弹出框
alert = driver.switch_to.alert
time.sleep(0.5)
except:
# 如果抛异常,说明当前页面不存在弹出框,即用户点击了取消或者确定
break
# 获取用户输入的链接地址
target_url = WebDriverWait(driver, 20).until(EC.presence_of_element_located((By.ID, random_id)))
value = target_url.get_attribute('value')
# 删除空格
value = value.strip()
# 判断输入的链接地址是否正确
if( value != '' and 'https://chushu.la' in value):
break
return value
def make_album(self):
chromedriver_path = './chromedriver_mac_74.0.3729.6'
option = webdriver.ChromeOptions()
# 屏蔽chrome的提示
option.add_argument('disable-infobars')
# 静默自动打印为高清PDF文件,并存储到os.getcwd()目录,也就是当前目录
appState = {
# 添加保存为pdf选项
"recentDestinations": [
{
"id": "Save as PDF",
"origin": "local",
"account":""
}
],
# 选择保存为pdf选项
"selectedDestinationId": "Save as PDF",
# 版本2
"version": 2,
# 不显示页眉页脚
"isHeaderFooterEnabled": False
}
profile = {
# 打印前置参数
'printing.print_preview_sticky_settings.appState': json.dumps(appState),
# 默认下载、打印保存路径
'savefile.default_directory': self.path
}
# 添加实验性质的设置参数
option.add_experimental_option('prefs', profile)
# 添加启动参数,后台静默打印
option.add_argument('--kiosk-printing')
# 绑定Chrome和chromedriver,不同Chrome版本对应的chromedriver是不同的,请注意
driver = webdriver.Chrome(options=option)
# 将浏览器最大化显示,使得截图效果更好
driver.maximize_window()
# 延迟2秒,给最大化过程一点时间
time.sleep(2)
# 你的微信朋友圈数据地址,注意不要泄露给其他人
# 在调试过程中,可以直接给target_url赋值
target_url = self.input_url(driver)
# 模拟浏览指定网页
driver.get(target_url)
for i in range(0, 10000):
# 等待当前页面所有数据加载完毕,正常情况下数据加载完毕后,这个‘加载中’元素会隐藏起来
while (True):
loading_status = WebDriverWait(driver, 20).until(
EC.presence_of_element_located((By.CSS_SELECTOR, 'div.j-save-popup.save-popup')))
if (loading_status.is_displayed() == False):
break
# 隐藏导航栏,防止影响截图效果
js = 'document.querySelector("body > header").style.display="none";'
driver.execute_script(js)
# 等待 下一月控件 出现
next_month = WebDriverWait(driver, 20).until(EC.presence_of_element_located((By.CSS_SELECTOR, 'button.next-month')))
# 等待 下一月控件 可见才能模拟点击
while(True):
if(next_month.is_displayed() == True):
break
# 模拟点击 下一月控件
time.sleep(0.5)
next_month.click()
# 判断当下一月控件的class name 是否为next-month disable,如果是,则说明翻到最后一月了
page_source = driver.page_source
if('next-month disable' in page_source):
# 等待当前页面所有数据加载完毕,正常情况下数据加载完毕后,这个‘加载中’元素会隐藏起来
while (True):
loading_status = WebDriverWait(driver, 20).until(
EC.presence_of_element_located((By.CSS_SELECTOR, 'div.j-save-popup.save-popup')))
if (loading_status.is_displayed() == False):
break
# 等待 主页面控件 出现
WebDriverWait(driver, 20).until(EC.presence_of_element_located((By.CSS_SELECTOR, 'ul.main')))
main = driver.find_element_by_css_selector('ul.main')
element_left_list = main.find_elements_by_css_selector('div.con-left')
# 每一个element代表每一页,将每一页中style的display属性改成block,即可见状态
for index, element in enumerate(element_left_list):
# ..在xpath中表示上一级的元素,也就是父元素
parent_element = element.find_element_by_xpath('..')
# 获取这个父元素的完整id
parent_element_id = parent_element.get_attribute('id')
# 将该父元素更改为可见状态
js = 'document.getElementById("{}").style.display="block";'.format(parent_element_id)
driver.execute_script(js)
# 将每一页之间的间隔去掉
js = 'document.getElementById("{}").style.marginTop="0px";'.format(parent_element_id)
driver.execute_script(js)
# 由于网站的图片是懒加载形式,所以需要挨个定位到每张图片的位置
# 每次寻找是否存在类名为lazy-img的img元素集合,当元素集合至少存在一个元素,则定位到第一个元素
# 当元素集合不存在任何元素,则说明懒加载的图片已经没有了,可以退出循环了
while(True):
try:
lazy_img = driver.find_elements_by_css_selector('img.lazy-img')
js = 'document.getElementsByClassName("lazy-img")[0].scrollIntoView();'
driver.execute_script(js)
time.sleep(3)
except:
# 找不到控件img.lazy-img,所以退出循环
break
break
# 调用chrome打印功能
driver.execute_script('window.print();')
# 退出浏览器
driver.quit()
================================================
FILE: Spiders/oschina/main.py
================================================
import re
import os
import sys
import json
import requests
from bs4 import BeautifulSoup
from tkinter.filedialog import askdirectory
class Oschina(object):
def __init__(self, blogurl):
self.blogurl = blogurl
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.89 Safari/537.36'
}
def get_element_of_article(self):
'''
获取元素(标题,发布时间,阅读量)
'''
# url = blogurl + 'widgets/_space_index_newest_blog?catalogId=0&q=&p={}&type=ajax'
url = self.blogurl + '/widgets/_space_index_newest_blog'
pos = 1
article_list = []
while 1:
key_dict = {
'catalogId': '0',
'q': '',
'p': str(pos),
'type': 'ajax'
}
reps = requests.get(url, headers=self.headers, params=key_dict, timeout=10)
soup = BeautifulSoup(reps.text, "html.parser")
posts = soup.find_all("div", class_="content")
# print(len(posts))
if not len(posts):
break
date_pattern = re.compile(r"\d+/\d{1,2}/\d{1,2}")
time_pattern = re.compile(r"\d{2}:\d{2}")
from tqdm import tqdm
pbar = tqdm(posts)
for each_post in pbar:
try:
item = {}
item['title'] = each_post.find("a", class_="header").text.replace(" ", "").split('\n')[-2]
item['sumary'] = each_post.find("div", class_="description").text.strip().replace('\n', '')
item['postdate'] = date_pattern.findall(posts[3].find("div", class_="extra").text)[0]
item['posttime'] = time_pattern.findall(posts[3].find("div", class_="extra").text)[0]
item['views'] = each_post.find("div", class_="extra").find_all('div', class_='item')[-2].text.strip()
article_list.append(item)
pbar.set_description("正在爬取文章:%s" % item['title'])
except:
pass
import time
time.sleep(0.1)
pos += 1
article_json = json.dumps(article_list)
return article_json
def save_as_json(self, content_json):
with open(self.path + os.sep + 'oschina_article.json', 'w', encoding='utf-8') as f:
f.write(content_json)
if __name__ == '__main__':
article = get_element_of_article('https://my.oschina.net/kangvcar')
save_as_json(article)
================================================
FILE: Spiders/qqfriend/main.py
================================================
import selenium
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
import json
import tkinter as tk
from tkinter.filedialog import asksaveasfilename
from tkinter.filedialog import askdirectory
from bs4 import BeautifulSoup
import lxml
# import openpyxl
# from openpyxl import Workbook
class Qqfriend(object):
def __init__(self):
# 浏览器位置
self.driver = webdriver.Chrome()
self.browser = self.driver
# self.browser = webdriver.Chrome()
self.browser.get("https://pay.qq.com/index.shtml")
self.root = tk.Tk()
# 设置窗口标题
self.root.title('从QQ充值获取好友列表')
# 设置窗口大小
self.root.geometry('400x200')
# 进入消息循环(检测到事件,就刷新组件)
# button1 = tk.Button(self.root, text='已登陆并打开充值界面且点开列表(不用选择表项),保存为excel', command=self.callback_excel)
# button1.pack()
button2 = tk.Button(self.root, text='已登陆并打开充值界面且,点开列表(不用选择表项),保存为json', command=self.callback_json)
button2.pack()
button3 = tk.Button(self.root, text='爬取完成后点击此按钮', command=self.close_chrome)
button3.pack()
self.root.mainloop()
# 存储为excel
# def callback_excel(self):
# self.driver.switch_to_frame('webpay-iframe')
# iframe = self.driver.find_element_by_xpath('//*[@id="midas-webpay-main-1450000186"]/div[2]/div[1]/iframe')
# self.driver.switch_to_frame(iframe)
# html = self.driver.page_source
# soup = BeautifulSoup(html, "lxml")
# a = soup.find_all(attrs={'class': 'icon-friend-s'})
# wb = Workbook()
# ws = wb.active
# ws.append(["raw", "group", "view_name", "qqnumber"])
# for i in a:
# if i.next_sibling != ' {{el.name}}({{el.qq}})':
# k = 0
# for x in i.next_sibling:
# if x == '(':
# f = k
# if x == ')':
# l = k
# k = k + 1
# ws.append([i.next_sibling, i.next_sibling.parent.parent.parent.parent.find(
# attrs={'class': 'icon-more-friend'}).next_sibling, i.next_sibling[:f], i.next_sibling[f + 1:l]])
# print([i.next_sibling, i.next_sibling.parent.parent.parent.parent.find(
# attrs={'class': 'icon-more-friend'}).next_sibling, i.next_sibling[:f], i.next_sibling[f + 1:l]])
# wb.save(asksaveasfilename(defaultextension='.xlsx', filetypes=[('Excel 工作簿', '*.xlsx')]))
# return 0
# 存储为json
def callback_json(self):
self.path = askdirectory(title='选择信息保存文件夹')
self.driver.switch_to_frame('webpay-iframe')
iframe = self.driver.find_element_by_xpath('//*[@id="midas-webpay-main-1450000186"]/div[2]/div[1]/iframe')
self.driver.switch_to_frame(iframe)
html = self.driver.page_source
soup = BeautifulSoup(html, "lxml")
a = soup.find_all(attrs={'class': 'icon-friend-s'})
from tqdm import tqdm
pbar = tqdm(a)
friend_list = []
for i in pbar:
if i.next_sibling != ' {{el.name}}({{el.qq}})':
k = 0
for x in i.next_sibling:
if x == '(':
f = k
if x == ')':
l = k
k = k + 1
item = {}
item['raw'] = i.next_sibling
item['group'] = i.next_sibling.parent.parent.parent.parent.find(
attrs={'class': 'icon-more-friend'}).next_sibling
item['view_name'] = i.next_sibling[:f]
item['qqnumber'] = i.next_sibling[f + 1:l]
friend_list.append(item)
pbar.set_description("正在爬取:%s" % item['raw'])
friend_list_json = json.dumps(friend_list, ensure_ascii=False)
# print(friend_list_json)
with open(self.path + '/friend_list.json', 'w', encoding="utf-8") as f:
f.write(friend_list_json)
self.close_chrome()
return 0
def close_chrome(self):
self.browser.close()
self.root.destroy()
return 0
================================================
FILE: Spiders/qqqun/main.py
================================================
# -*- coding: utf-8 -*-
import selenium
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
import tkinter as tk
from tkinter import *
from tkinter.filedialog import askdirectory
from lxml import etree
import lxml
from bs4 import BeautifulSoup
import time
import os
import json
import pandas
class Qqqun(object):
def __init__(self):
self.path = askdirectory(title='选择信息保存文件夹')
self.driver = webdriver.Chrome()
self.browser = self.driver
self.browser.get("https://qun.qq.com/member.html")
self.root = tk.Tk()
# 设置窗口标题
self.root.title('从QQ群管理获取群成员列表')
# 设置窗口大小
self.root.geometry('400x200')
# 进入消息循环(检测到事件,就刷新组件)
# button1 = tk.Button(self.root, text='已登陆并打开界面,保存为excel', pady=5, command=self.callback_excel)
# button1.pack()
button2 = tk.Button(self.root, text='已登陆并打开界面,保存为json', pady=5, command=self.callback_json)
button2.pack()
button3 = tk.Button(self.root, text='爬取完成后点击此按钮', pady=5, command=self.close_chrome)
button3.pack()
self.root.mainloop()
# 去字符串两端'\n'、'\t'
def delNT(self, s):
while s.startswith('\n') or s.startswith('\t'):
s = s[1:]
while s.endswith('\t') or s.endswith('\n'):
s = s[:-1]
return s
# def callback_excel(self):
# a = self.driver.find_elements_by_class_name('icon-def-gicon')
# Num = len(a)
# time_start = time.time()
# for i in range(0, Num):
# # 点击进入具体群
# a = self.driver.find_elements_by_class_name('icon-def-gicon')
# # time.sleep(0.5)
# a[i].click()
# time.sleep(1)
# html = self.driver.page_source
# soup = BeautifulSoup(html, "lxml")
# groupTit = self.delNT(soup.find(attrs={'id': 'groupTit'}).text)
# groupMemberNum = self.delNT(soup.find(attrs={'id': 'groupMemberNum'}).text)
# while len(soup.find_all(attrs={'class': 'td-no'})) < int(groupMemberNum):
# self.driver.execute_script("window.scrollTo(0,document.body.scrollHeight);")
# time.sleep(0.1)
# html = self.driver.page_source
# soup = BeautifulSoup(html, "lxml")
# res_elements = etree.HTML(html)
# table = res_elements.xpath('//*[@id="groupMember"]')
# table = etree.tostring(table[0], encoding='utf-8').decode()
# df = pandas.read_html(table, encoding='utf-8', header=0)[0]
# try:
# print(str(int((time.time() - time_start) / 60)) + ':' + str(int((time.time() - time_start) % 60)),
# '第' + str(i + 1) + '群,' + str(int((i + 1) / Num * 100)) + '% ' + groupTit + ' 此表完成')
# writer = pandas.ExcelWriter(self.path + '/' + groupTit + '.xlsx')
# df.to_excel(writer, 'Sheet1')
# writer.save()
# except:
# k = 0
# for v in groupTit:
# if v == '(':
# f = k
# if v == ')':
# l = k
# k = k + 1
# writer = pandas.ExcelWriter(self.path + '/' + groupTit[f + 1:l] + '.xlsx')
# df.to_excel(writer, 'Sheet1')
# writer.save()
# self.driver.find_element_by_id('changeGroup').click()
# time.sleep(1)
# self.close_chrome()
# return 0
def callback_json(self):
a = self.driver.find_elements_by_class_name('icon-def-gicon')
Num = len(a)
time_start = time.time()
# for i in range(0, Num):
from tqdm import trange
for i in trange(Num):
# 点击进入具体群
a = self.driver.find_elements_by_class_name('icon-def-gicon')
# time.sleep(0.5)
a[i].click()
time.sleep(1)
html = self.driver.page_source
soup = BeautifulSoup(html, "lxml")
groupTit = self.delNT(soup.find(attrs={'id': 'groupTit'}).text)
groupMemberNum = self.delNT(soup.find(attrs={'id': 'groupMemberNum'}).text)
# 模拟滚动到顶部以查看所有信息
while len(soup.find_all(attrs={'class': 'td-no'})) < int(groupMemberNum):
self.driver.execute_script("window.scrollTo(0,document.body.scrollHeight);")
time.sleep(0.1)
html = self.driver.page_source
soup = BeautifulSoup(html, "lxml")
res_elements = etree.HTML(html)
table = res_elements.xpath('//*[@id="groupMember"]')
table = etree.tostring(table[0], encoding='utf-8').decode()
df = pandas.read_html(table, encoding='utf-8', header=0)[0]
try:
# print(str(int((time.time() - time_start) / 60)) + ':' + str(int((time.time() - time_start) % 60)),
# '第' + str(i + 1) + '群,' + str(int((i + 1) / Num * 100)) + '% ' + groupTit + ' 此表完成')
# df.drop(['Unnamed: 0','Unnamed: 1','Unnamed: 10'],axis=1,inplace=True)
# df.columns = ['member', 'nick_name', 'qqnumber', 'sex', 'qqage', 'join_date', 'last_post']
qun_friend_list = []
for j in range(0, df.shape[0]):
item = {}
data = df.values[j].tolist()
item['member'] = data[2]
item['nick_name'] = data[3]
item['qqnumber'] = data[4]
item['sex'] = data[5]
item['qqage'] = data[6]
item['join_date'] = data[7]
item['last_post'] = data[8]
qun_friend_list.append(item)
# print(item)
qun_friend_list_json = json.dumps(qun_friend_list, ensure_ascii=False)
with open(self.path + '/' + groupTit + '.json', 'w', encoding="utf-8") as f:
f.write(qun_friend_list_json)
except:
k = 0
for v in groupTit:
if v == '(':
f = k
if v == ')':
l = k
k = k + 1
self.driver.find_element_by_id('changeGroup').click()
time.sleep(1)
self.close_chrome()
return 0
def close_chrome(self):
self.browser.close()
self.root.destroy()
return 0
================================================
FILE: Spiders/shgjj/main.py
================================================
import json
import os
import requests
class GjjSpider(object):
def __init__(self, cookie, token):
self.session = requests.session()
self.token = token
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
'Authorization': 'Bearer ' + self.token
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
def write_json(self, name, str):
file_path = os.path.join(os.path.dirname(__file__) + '/' + name)
with open(file_path, 'w') as f:
f.write(str)
# 住房公积金,补充公积金账户
def get_priaccountForWeb(self):
url = 'http://person.shgjj.com/gjjapi/private/priaccountForWeb?token={}&source=WANGZHAN'.format(self.token)
self.headers['Referer'] = 'http://person.shgjj.com/gjjweb/'
resp = self.session.get(url, headers=self.headers)
self.write_json('priaccountForWeb_gjj.json', resp.content.decode())
# 贷款账户
def get_accountForWeb(self):
url = 'http://person.shgjj.com/gjjapi/loan/accountForWeb?token={}&source=WANGZHAN'.format(self.token)
self.headers['Referer'] = 'http://person.shgjj.com/gjjweb/'
resp = self.session.get(url, headers=self.headers)
self.write_json('贷款账户.json', resp.content.decode())
if __name__ == '__main__':
pass
cookie = 'ic-GJJGeRen=r-GJJGeRen-1;eks_cache_keys=true;'
# token = 'eyJhbGciOiJIUzUxMiJ9.eyJzdWIiOiIxMDA0OTgwNTAyMDUiLCJhdXRoIjoiUk9MRV9BRE1JTixST0xFX1VTRVIiLCJleHAiOjE1NTY2MTYwNTZ9.TAUPynGD52hwscJmM2Icam2q5SNXimQAFG19G9a4cESUh1eSBRLnbm6ZfTfEw62gUaR_movqxKeKWxMXIXXeJg'
token = 'eyJhbGciOiJIUzUxMiJ9.eyJzdWIiOiIxMDA0OTgwNTAyMDUiLCJhdXRoIjoiUk9MRV9BRE1JTixST0xFX1VTRVIiLCJleHAiOjE1NTY2MTYwNTZ9.TAUPynGD52hwscJmM2Icam2q5SNXimQAFG19G9a4cESUh1eSBRLnbm6ZfTfEw62gUaR_movqxKeKWxMXIXXeJg'
spider = GjjSpider(cookie, token)
spider.get_priaccountForWeb()
spider.get_accountForWeb()
================================================
FILE: Spiders/taobao/spider.py
================================================
import json
import random
import time
import sys
import os
import requests
import numpy as np
import math
from lxml import etree
from pyquery import PyQuery as pq
from selenium import webdriver
from selenium.webdriver import ChromeOptions
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.support.wait import WebDriverWait
from selenium.webdriver import ChromeOptions, ActionChains
from tkinter.filedialog import askdirectory
from tqdm import trange
def ease_out_quad(x):
return 1 - (1 - x) * (1 - x)
def ease_out_quart(x):
return 1 - pow(1 - x, 4)
def ease_out_expo(x):
if x == 1:
return 1
else:
return 1 - pow(2, -10 * x)
def get_tracks(distance, seconds, ease_func):
tracks = [0]
offsets = [0]
for t in np.arange(0.0, seconds, 0.1):
ease = globals()[ease_func]
offset = round(ease(t / seconds) * distance)
tracks.append(offset - offsets[-1])
offsets.append(offset)
return offsets, tracks
def drag_and_drop(browser, offset=26.5):
knob = browser.find_element_by_id('nc_1_n1z')
offsets, tracks = get_tracks(offset, 12, 'ease_out_expo')
ActionChains(browser).click_and_hold(knob).perform()
for x in tracks:
ActionChains(browser).move_by_offset(x, 0).perform()
ActionChains(browser).pause(0.5).release().perform()
def gen_session(cookie):
session = requests.session()
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(session.cookies, cookie_dict)
return session
class TaobaoSpider(object):
def __init__(self, cookies_list):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
option = ChromeOptions()
option.add_experimental_option('excludeSwitches', ['enable-automation'])
option.add_experimental_option("prefs", {"profile.managed_default_content_settings.images": 2}) # 不加载图片,加快访问速度
option.add_argument('--headless')
self.driver = webdriver.Chrome(options=option)
self.driver.get('https://i.taobao.com/my_taobao.htm')
for i in cookies_list:
self.driver.add_cookie(cookie_dict=i)
self.driver.get('https://i.taobao.com/my_taobao.htm')
self.wait = WebDriverWait(self.driver, 20) # 超时时长为10s
# 模拟向下滑动浏览
def swipe_down(self, second):
for i in range(int(second / 0.1)):
# 根据i的值,模拟上下滑动
if (i % 2 == 0):
js = "var q=document.documentElement.scrollTop=" + str(300 + 400 * i)
else:
js = "var q=document.documentElement.scrollTop=" + str(200 * i)
self.driver.execute_script(js)
time.sleep(0.1)
js = "var q=document.documentElement.scrollTop=100000"
self.driver.execute_script(js)
time.sleep(0.1)
# 爬取淘宝 我已买到的宝贝商品数据, pn 定义爬取多少页数据
def crawl_good_buy_data(self, pn=3):
# 对我已买到的宝贝商品数据进行爬虫
self.driver.get("https://buyertrade.taobao.com/trade/itemlist/list_bought_items.htm")
# 遍历所有页数
for page in trange(1, pn):
data_list = []
# 等待该页面全部已买到的宝贝商品数据加载完毕
good_total = self.wait.until(
EC.presence_of_element_located((By.CSS_SELECTOR, '#tp-bought-root > div.js-order-container')))
# 获取本页面源代码
html = self.driver.page_source
# pq模块解析网页源代码
doc = pq(html)
# # 存储该页已经买到的宝贝数据
good_items = doc('#tp-bought-root .js-order-container').items()
# 遍历该页的所有宝贝
for item in good_items:
# 商品购买时间、订单号
good_time_and_id = item.find('.bought-wrapper-mod__head-info-cell___29cDO').text().replace('\n', "").replace('\r', "")
# 商家名称
# good_merchant = item.find('.seller-mod__container___1w0Cx').text().replace('\n', "").replace('\r', "")
good_merchant = item.find('.bought-wrapper-mod__seller-container___3dAK3').text().replace('\n', "").replace('\r', "")
# 商品名称
# good_name = item.find('.sol-mod__no-br___1PwLO').text().replace('\n', "").replace('\r', "")
good_name = item.find('.sol-mod__no-br___3Ev-2').text().replace('\n', "").replace('\r', "")
# 商品价格
good_price = item.find('.price-mod__price___cYafX').text().replace('\n', "").replace('\r', "")
# 只列出商品购买时间、订单号、商家名称、商品名称
# 其余的请自己实践获取
data_list.append(good_time_and_id)
data_list.append(good_merchant)
data_list.append(good_name)
data_list.append(good_price)
#print(good_time_and_id, good_merchant, good_name)
#file_path = os.path.join(os.path.dirname(__file__) + '/user_orders.json')
# file_path = "../Spiders/taobao/user_orders.json"
json_str = json.dumps(data_list)
with open(self.path + os.sep + 'user_orders.json', 'a') as f:
f.write(json_str)
# print('\n\n')
# 大部分人被检测为机器人就是因为进一步模拟人工操作
# 模拟人工向下浏览商品,即进行模拟下滑操作,防止被识别出是机器人
# 随机滑动延时时间
swipe_time = random.randint(1, 3)
self.swipe_down(swipe_time)
# 等待下一页按钮 出现
good_total = self.wait.until(EC.presence_of_element_located((By.CSS_SELECTOR, '.pagination-next')))
good_total.click()
time.sleep(2)
# while 1:
# time.sleep(0.2)
# try:
# good_total = self.driver.find_element_by_xpath('//li[@title="下一页"]')
# break
# except:
# continue
# # 点击下一页按钮
# while 1:
# time.sleep(2)
# try:
# good_total.click()
# break
# except Exception:
# pass
# 收藏宝贝 传入爬几页 默认三页 https://shoucang.taobao.com/nodejs/item_collect_chunk.htm?ifAllTag=0&tab=0&tagId=&categoryCount=0&type=0&tagName=&categoryName=&needNav=false&startRow=60
def get_choucang_item(self, page=3):
url = 'https://shoucang.taobao.com/nodejs/item_collect_chunk.htm?ifAllTag=0&tab=0&tagId=&categoryCount=0&type=0&tagName=&categoryName=&needNav=false&startRow={}'
pn = 0
json_list = []
for i in trange(page):
self.driver.get(url.format(pn))
pn += 30
html_str = self.driver.page_source
if html_str == '':
break
if '登录' in html_str:
raise Exception('登录')
obj_list = etree.HTML(html_str).xpath('//li')
for obj in obj_list:
item = {}
item['title'] = ''.join([i.strip() for i in obj.xpath('./div[@class="img-item-title"]//text()')])
item['url'] = ''.join([i.strip() for i in obj.xpath('./div[@class="img-item-title"]/a/@href')])
item['price'] = ''.join([i.strip() for i in obj.xpath('./div[@class="price-container"]//text()')])
if item['price'] == '':
item['price'] = '失效'
json_list.append(item)
# file_path = os.path.join(os.path.dirname(__file__) + '/shoucang_item.json')
json_str = json.dumps(json_list)
with open(self.path + os.sep + 'shoucang_item.json', 'w') as f:
f.write(json_str)
# 浏览足迹 传入爬几页 默认三页 https://shoucang.taobao.com/nodejs/item_collect_chunk.htm?ifAllTag=0&tab=0&tagId=&categoryCount=0&type=0&tagName=&categoryName=&needNav=false&startRow=60
def get_footmark_item(self, page=3):
url = 'https://www.taobao.com/markets/footmark/tbfoot'
self.driver.get(url)
pn = 0
item_num = 0
json_list = []
for i in trange(page):
html_str = self.driver.page_source
obj_list = etree.HTML(html_str).xpath('//div[@class="item-list J_redsList"]/div')[item_num:]
for obj in obj_list:
item_num += 1
item = {}
item['date'] = ''.join([i.strip() for i in obj.xpath('./@data-date')])
item['url'] = ''.join([i.strip() for i in obj.xpath('./a/@href')])
item['name'] = ''.join([i.strip() for i in obj.xpath('.//div[@class="title"]//text()')])
item['price'] = ''.join([i.strip() for i in obj.xpath('.//div[@class="price-box"]//text()')])
json_list.append(item)
self.driver.execute_script('window.scrollTo(0,1000000)')
# file_path = os.path.join(os.path.dirname(__file__) + '/footmark_item.json')
json_str = json.dumps(json_list)
with open(self.path + os.sep + 'footmark_item.json', 'w') as f:
f.write(json_str)
# 地址
def get_addr(self):
url = 'https://member1.taobao.com/member/fresh/deliver_address.htm'
self.driver.get(url)
html_str = self.driver.page_source
obj_list = etree.HTML(html_str).xpath('//tbody[@class="next-table-body"]/tr')
data_list = []
for obj in obj_list:
item = {}
item['name'] = obj.xpath('.//td[1]//text()')
item['area'] = obj.xpath('.//td[2]//text()')
item['detail_area'] = obj.xpath('.//td[3]//text()')
item['youbian'] = obj.xpath('.//td[4]//text()')
item['mobile'] = obj.xpath('.//td[5]//text()')
data_list.append(item)
# file_path = os.path.join(os.path.dirname(__file__) + '/addr.json')
json_str = json.dumps(data_list)
with open(self.path + os.sep + 'address.json', 'w') as f:
f.write(json_str)
if __name__ == '__main__':
# pass
cookie_list = json.loads(open('taobao_cookies.json', 'r').read())
t = TaobaoSpider(cookie_list)
t.get_orders()
# t.crawl_good_buy_data()
# t.get_addr()
# t.get_choucang_item()
# t.get_footmark_item()
================================================
FILE: Spiders/telephone/main.py
================================================
import json
import os
import re
import sys
import xlsxwriter
import requests
from tkinter.filedialog import askdirectory
from requests.packages.urllib3.exceptions import InsecureRequestWarning
# 禁用安全请求警告
requests.packages.urllib3.disable_warnings(InsecureRequestWarning)
class LianTong(object):
def __init__(self, cookie):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
self.cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
self.cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
self.cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(self.session.cookies, self.cookie_dict)
self.mobile = None
def get_user_info(self):
import time
url = 'http://iservice.10010.com/e3/static/query/searchPerInfoUser/'
resp = self.session.post(url, headers=self.headers, verify=False)
file_path = os.path.join(self.path + '/10010_user_info.json')
with open(file_path, 'w', encoding='utf-8') as f:
f.write(resp.content.decode())
# 查询账单 http://iservice.10010.com/e3/static/wohistory/bill?dat=201902 可传入时间
def get_bill_info(self, dat=''):
try:
url = 'http://iservice.10010.com/e3/static/wohistory/bill?dat={}'.format(dat)
self.headers['Referer'] = 'http://iservice.10010.com/e4/skip.html?menuCode=000100020001'
resp = self.session.post(url, data='', headers=self.headers, verify=False)
# print(resp)
file_path = os.path.join(self.path + '/10010_bill_info.json')
with open(file_path, 'w', encoding='utf-8') as f:
f.write(resp.content.decode())
except Exception:
# 捕获到异常说明是短信登录,非服务密码登录
pass
class DianXin(object):
def __init__(self, cookie):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
self.mobile = None
resp = self.session.get('https://service.sh.189.cn/service/mytelecom/deviceInfo', headers=self.headers,
verify=False)
self.mobile = re.findall('var login = "(\d{11})";', resp.content.decode())[0]
print(self.mobile)
def get_user_info(self):
url = 'https://service.sh.189.cn/service/my/basicinfo.do'
resp = self.session.post(url, data=None, headers=self.headers, verify=False)
file_path = os.path.join(os.path.dirname(__file__) + '/' + '10000_user.json')
with open(file_path, 'w') as f:
f.write(resp.content.decode())
# 查询账单 http://iservice.10010.com/e3/static/wohistory/bill?dat=201902 可传入时间
def get_bill_info(self, dat=''):
try:
url = 'https://service.sh.189.cn/service/mobileBill.do'
self.headers['Referer'] = 'https://service.sh.189.cn/service/query/bill'
self.headers['Content-Type'] = 'application/x-www-form-urlencoded; charset=UTF-8'
print('device={}&acctNum='.format(self.mobile))
resp = self.session.post(url, data='device={}&acctNum='.format(self.mobile), headers=self.headers,
verify=False)
file_path = os.path.join(os.path.dirname(__file__) + '/' + '10000_bill_info.json')
with open(file_path, 'w') as f:
f.write(resp.content.decode())
except Exception:
# 捕获到异常说明是短信登录,非服务密码登录
pass
if __name__ == '__main__':
pass
# y = YiDong(
# y.get_user_info()
# y.get_bill_info()
# l = LianTong(
# l.get_user_info()
# l.get_bill_info()
# d = DianXin(
# # d.get_user_info()
# d.get_bill_info()
# http://www.189.cn/dqmh/ssoLink.do?method=skip&platNo=93507&toStUrl=http://service.sh.189.cn/service/self_index
# http://ah.189.cn/service/
# http://www.189.cn/dqmh/frontLinkSkip.do?method=skip&shopId=10011&toStUrl=http://js.189.cn/nservice/login/toIndex
================================================
FILE: Spiders/yidong/main.py
================================================
import json
import os
import re
import xlsxwriter
import sys
import requests
from requests.packages.urllib3.exceptions import InsecureRequestWarning
from tkinter.filedialog import askdirectory
requests.packages.urllib3.disable_warnings(InsecureRequestWarning)
class YiDong(object):
def __init__(self, cookie):
self.path = askdirectory(title='选择信息保存文件夹')
if str(self.path) == "":
sys.exit(1)
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
cookie_dict = {}
list = cookie.split(';')
for i in list:
try:
cookie_dict[i.split('=')[0]] = i.split('=')[1]
except IndexError:
cookie_dict[''] = i
requests.utils.add_dict_to_cookiejar(self.session.cookies, cookie_dict)
self.mobile = None
def get_user_info(self):
# print('执行----> get_user_info')
url = 'https://shop.10086.cn/i/v1/auth/loginfo'
resp = self.session.get(url, headers=self.headers, verify=False)
self.mobile = json.loads(resp.content.decode())['data']['loginValue']
def get_bill_info(self):
# print('执行----> get_bill_info')
# Get the mobile number from the website
self.get_user_info()
# Download the bill string
bill_json_str = self.get_bill_json()
# transfer and save the bill
self.transfer_and_save_bill(bill_json_str)
def get_bill_json(self):
# print('执行----> get_bill_json')
# constract the request url
begin_month = '202001'
# end_month = '202004'
import datetime
end_month = str(datetime.date.today().strftime('%Y%m'))
url = 'https://touch.10086.cn/i/v1/fee/touchbillinfo/'+self.mobile+'?bgnMonth='+begin_month+'&endMonth='+end_month+'&time=202062215373895&channel=02'
self.headers['Referer'] = 'https://touch.10086.cn/i/mobile/billqry.html'
# get the bill json from website
resp = self.session.get(url, headers=self.headers, verify=False)
return resp.content.decode()
def transfer_and_save_bill(self, bill_json_str):
# print('执行----> transfer_and_save_bill')
bill_json = json.loads(bill_json_str)
bill_json_month_lists = bill_json['data']
bill_details = {}
for i in range(len(bill_json_month_lists)):
bill_json_month = bill_json_month_lists[i]
month = bill_json_month['billMonth']
month_item_lists = bill_json_month['billMaterials']
item_month = []
for j in range(len(month_item_lists)):
bill_item = month_item_lists[j]['billMaterialInfos']
if len(bill_item) != 0:
for k in bill_item:
item_month.append(k)
bill_details[month] = item_month
with open(self.path + os.sep + 'yidong_bill.json', 'w', encoding='utf-8') as f:
f.write(json.dumps(bill_details))
# print(bill_details)
print('Done.')
================================================
FILE: Spiders/zhihu/main.py
================================================
# import zhihuapi as zhihu
import requests
from tkinter.filedialog import askdirectory
class Zhihu(object):
def __init__(self, userToken):
self.path = askdirectory(title='选择信息保存文件夹')
self.userToken = userToken
self.session = requests.session()
self.headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36',
}
# 把信息写入文件
def info_write_to_json(self, filename, response):
json_path = self.path + '/' + filename + '.json'
with open(json_path, 'w') as f:
f.write(response)
return json_path
# 获取用户基本信息
def get_user_profile(self):
url = 'https://www.zhihu.com/api/v4/members/' + self.userToken
resp = self.session.get(url, headers=self.headers).content.decode()
print(resp)
self.info_write_to_json('user_profile', resp)
# 获取用户关注的人
def get_user_followees(self):
url = 'https://www.zhihu.com/api/v4/members/' + self.userToken + '/followees'
resp = self.session.get(url, headers=self.headers).content.decode()
print(resp)
self.info_write_to_json('user_followees', resp)
# 获取用户的粉丝
def get_user_followers(self):
url = 'https://www.zhihu.com/api/v4/members/' + self.userToken + '/followers'
resp = self.session.get(url, headers=self.headers).content.decode()
print(resp)
self.info_write_to_json('user_followers', resp)
# 获取用户发布的文章
def get_user_articles(self):
url = 'https://www.zhihu.com/api/v4/members/' + self.userToken + '/articles'
resp = self.session.get(url, headers=self.headers).content.decode()
print(resp)
self.info_write_to_json('user_articles', resp)
# 获取用户的收藏
def get_user_collections(self):
url = 'https://www.zhihu.com/api/v4/members/' + self.userToken + '/collections'
resp = self.session.get(url, headers=self.headers).content.decode()
print(resp)
self.info_write_to_json('user_collections', resp)
# 获取用户发布的视频
def get_user_zvideos(self):
url = 'https://www.zhihu.com/api/v4/members/' + self.userToken + '/zvideos'
resp = self.session.get(url, headers=self.headers).content.decode()
print(resp)
self.info_write_to_json('user_zvideos', resp)
# 获取用户的动态
def get_user_activities(self):
url = 'https://www.zhihu.com/api/v4/members/' + self.userToken + '/activities'
resp = self.session.get(url, headers=self.headers).content.decode()
print(resp)
self.info_write_to_json('user_activities', resp)
================================================
FILE: docs/.nojekyll
================================================
================================================
FILE: docs/QuickStart.md
================================================
## Prerequisites
* Ubuntu 16.04
* Python3 & pip3
* Chrome Browser and [Chrome Driver](http://chromedriver.storage.googleapis.com/index.html) in the same version
## Installation
```
$ ./install_deps.sh
```
================================================
FILE: docs/README.md
================================================
# **INFO-SPIDER**
> 一个神奇的工具箱, 拿回你的个人信息.
# **Introduction**
## 开发者回忆录🌈
点击展开👉 开发者回忆录🌈
#### 场景一
小明一如往常打开 Chrome 浏览器逛着论坛,贴吧,一不小心点开了网页上的广告,跳转到了京东商城,下意识去关闭窗口时发现 (**OS:咦?京东怎么知道我最近心心念念的宝贝呢?刚好我正需要呢!**),既然打开了那就看看商品详情吧 (**OS:哎哟不错哦**),那就下单试试吧!
#### 场景二
小白听着网易云音乐的每日推荐歌单无法自拔 (**OS:哇!怎么播放列表里都是我喜欢的音乐风格?网易云音乐太棒了吧!深得我心啊!黑胶会员必须来一个!**),逛着知乎里的“如何优雅的XXX?”,“XXX是怎样一种体验?”,“如何评价XXX?” (**OS:咦?这个问题就是我刚好想问的,原来早已有人提问!什么???还有几千条回答!!进去逛逛看!**)
#### 场景三
小达上班时不忘充实自己,逛着各大技术论坛博客园、CSDN、开源中国、简书、掘金等等,发现首页的内容推荐太棒了(**OS:这些技术博文太棒了,不用找就出来了**),再打开自己的博客主页发现不知不觉地自己也坚持写博文也有三年了,自己的技术栈也越来越丰富(**OS:怎么博客后台都不提供一个数据分析系统呢?我想看看我这几年来的发文数量,发文时间,想知道哪些博文比较热门,想看看我在哪些技术上花费的时间更多,想看看我过去的创作高峰期时在晚上呢?还是凌晨?我希望系统能给我更多指引数据让我更好的创作!**)
看到以上几个场景你可能会感叹科技在进步,技术在发展,极大地改善了我们的生活方式。
但当你深入思考,你浏览的每个网站,注册的每个网站,他们都记录着你的信息你的足迹。
细思恐极的背后是自己的个人数据被赤裸裸的暴露在互联网上并且被众多的公司利用用户数据获得巨额利益,如对用户的数据收集分析后进行定制的广告推送,收取高额广告费。但作为数据的生产者却没能分享属于自己的数据收益。
#### 想法
如果有一个这样的工具,它能帮你拿回你的个人信息,它能帮你把分散在各种站点的个人信息聚合起来,它能帮你分析你的个人数据并给你提供建议,它能帮你把个人数据可视化让你更清楚地了解自己。
> 你是否会需要这样的工具呢? 你是否会喜欢这样的工具呢?
基于以上,我着手开发了 **[INFO-SPIDER](https://github.com/kangvcar/InfoSpider)** 👇👇👇
## Why INFO-SPIDER
- 个人数据蕴含巨大的价值, 未来的世界核心就是数据, 这是一个万亿级的市场. 众多的公司利用用户数据获得巨额利益, 如对用户的数据收集分析后进行定制的广告推送, 收取高额广告费. 但作为生产数据的最终用户, 却没能分享属于自己的数据收益.
- 个人数据分散在各种各样的公司之间, 经常形成数据孤岛, 多维数据无法融合. 很多优秀的创业公司, 被极大限制. 有算法、有创新,但缺乏合法且高效的途径访问数据.
- [INFO-SPIDER](https://github.com/kangvcar/InfoSpider) 项目旨在提供最全的工具帮助用户安全快捷的从数据寡头拿回自己的数据, 自由选择提供给数据需求方, 挖掘自己数据的金矿, 分享自己数据的价值.
## What is INFO-SPIDER
要想实现个人数据资产化, 如何拿回自己的数据是第一步, 一些数据寡头已经开始提供工具能让用户自由导出数据, 如谷歌公司, 已经提供方式让用户[下载](https://support.google.com/accounts/answer/3024190?hl=en)自己的数据.
这是一个好的开始, 但还不够, 还有很多公司没有提供官方工具或者只能下载很有限的数据. 而目前市面上的数据获取工具要么数据源不全, 要么不开源不透明. 无法保证工具本身不会偷偷窃取用户的数据, 甚至用户的用户名和密码.
[INFO-SPIDER](https://github.com/kangvcar/InfoSpider) 旨在安全快捷的帮助用户拿回**自己的数据**,工具代码开源,流程透明。并提供**数据分析**功能,基于用户数据生成图表文件,使得用户更直观、深入了解自己的信息。
## Features
- 安全可靠:本项目为开源项目,代码简洁,所有源码可见,本地运行,安全可靠。
- 使用简单:提供GUI界面,只需点击所需获取的数据源并根据提示操作即可。
- 结构清晰:本项目的所有数据源相互独立,可移植性高,**所有爬虫脚本在项目的[Spiders](https://github.com/kangvcar/InfoSpider/tree/master/Spiders)文件下**。
- 数据源丰富:本项目目前支持多达24+个数据源,持续更新。
- 数据格式统一:爬取的所有数据都将存储为json格式。
- 个人数据丰富:本项目将尽可能多地为你爬取个人数据,后期数据处理可根据需要删减。
- 数据分析:本项目提供个人数据的可视化分析,目前仅部分支持。
- 文档丰富:本项目包含完整全面的[使用说明文档](https://infospider.vercel.app)和[视频教程](https://www.bilibili.com/video/BV14f4y1R7oF/)
## Screenshot

## QuickStart
### 依赖安装
1. 安装[python3](https://www.python.org/downloads/)和Chrome浏览器
2. 安装与Chrome浏览器相同版本的[驱动](http://chromedriver.storage.googleapis.com/index.html)
3. 安装依赖库 `./install_deps.sh` (Windows下只需`pip install -r requirements.txt`)
!> 目前该工具箱仅在Windows环境下正常运行, 还未在Linux/MacOS环境下进行测试, 后续更新会兼容多平台.
### 工具运行
1. 进入 tools 目录
2. 运行 `python3 main.py`
3. 在打开的窗口**点击数据源按钮**, 根据提示**选择数据保存路径**
4. 弹出的浏览器**输入用户密码**后会自动开始爬取数据, 爬取完成浏览器会自动关闭.
5. 在对应的目录下可以**查看下载下来的数据**(xxx.json), **数据分析图表**(xxx.html)
?> 👍 每个数据源的爬取可能会生成多个文件, 所以建议为每个数据源新建一个文件夹来保存数据.
?> 数据分析功能还在开发中,暂时只支持部分数据源
!> 😘😘😘 如果你运行程序的过程中出现了错误, 或者爬取不到信息, 你可以通过 GitHub 提交[Issues](https://github.com/kangvcar/InfoSpider/issues)来告诉我们, 我们很乐意不断完善此项目.
## 购买服务
?> ***目前4折限量发售中...***,[去看看](https://mianbaoduo.com/o/bread/aZiTlJo=)
1. InfoSpider 最新维护版本
2. 更全面的个人数据分析
3. 免去安装程序的所有依赖环境,便捷,适合小白
4. 已打包好的程序,双击即可运行程序
5. 手把手教你如何打包 InfoSpider
6. 开发者一对一技术支持
7. ***购买后即可免费获得即将发布的全新2.0版本***
购买链接
## 数据源
- [x] GitHub
- [x] QQ邮箱
- [x] 网易邮箱
- [x] 阿里邮箱
- [x] 新浪邮箱
- [x] Hotmail邮箱
- [x] Outlook邮箱
- [x] 京东
- [x] 淘宝
- [x] 支付宝
- [x] 中国移动
- [x] 中国联通
- [x] 中国电信
- [x] 知乎
- [x] 哔哩哔哩
- [x] 网易云音乐
- [x] QQ好友
- [x] QQ群
- [x] 生成朋友圈相册
- [x] 浏览器浏览历史
- [x] 12306
- [x] 博客园
- [x] CSDN博客
- [x] 开源中国博客
- [x] 简书
!> 😊 如果没有找到你需要的数据源, 你可以通过 GitHub 提交[Issues](https://github.com/kangvcar/InfoSpider/issues)来告诉我们, 我们很乐意不断完善此项目.
## 数据分析
- [x] 博客园
- [x] CSDN博客
- [x] 开源中国博客
- [x] 简书
# **使用说明**
***
## GitHub
!> **说明**:无需登录账号, 输入GitHub用户名即可 (如 kangvcar ) .
### 使用步骤
1. 点击**GitHub**数据源按钮g

2. 输入GitHub用户名

3. 选择数据保存路径

?> 👍 每个数据源的爬取可能会生成多个文件, 所以建议为每个数据源新建一个文件夹来保存数据.
4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
user_infomation.json 👉 你的信息
```json
{
"login": "kangvcar",
"id": 20273349,
"node_id": "MDQ6VXNlcjIwMjczMzQ5",
"avatar_url": "https://avatars2.githubusercontent.com/u/20273349?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/kangvcar",
"html_url": "https://github.com/kangvcar",
"followers_url": "https://api.github.com/users/kangvcar/followers",
"following_url": "https://api.github.com/users/kangvcar/following{/other_user}",
"gists_url": "https://api.github.com/users/kangvcar/gists{/gist_id}",
"starred_url": "https://api.github.com/users/kangvcar/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/kangvcar/subscriptions",
"organizations_url": "https://api.github.com/users/kangvcar/orgs",
"repos_url": "https://api.github.com/users/kangvcar/repos",
"events_url": "https://api.github.com/users/kangvcar/events{/privacy}",
"received_events_url": "https://api.github.com/users/kangvcar/received_events",
"type": "User",
"site_admin": false,
"name": "Kangvcar",
"company": null,
"blog": "https://kangvcar.com",
"location": "Shenzhen, China",
"email": null,
"hireable": true,
"bio": "֪ʶ�Ĺ������ȵĸ���Ʒ",
"twitter_username": null,
"public_repos": 76,
"public_gists": 2,
"followers": 17,
"following": 2,
"created_at": "2016-07-04T02:02:34Z",
"updated_at": "2020-07-13T17:35:51Z"
}
```
user_followers.json 👉 你的粉丝信息
```json
[
{
"login": "huangguangda",
"id": 30596987,
"node_id": "MDQ6VXNlcjMwNTk2OTg3",
"avatar_url": "https://avatars2.githubusercontent.com/u/30596987?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/huangguangda",
"html_url": "https://github.com/huangguangda",
"followers_url": "https://api.github.com/users/huangguangda/followers",
"following_url": "https://api.github.com/users/huangguangda/following{/other_user}",
"gists_url": "https://api.github.com/users/huangguangda/gists{/gist_id}",
"starred_url": "https://api.github.com/users/huangguangda/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/huangguangda/subscriptions",
"organizations_url": "https://api.github.com/users/huangguangda/orgs",
"repos_url": "https://api.github.com/users/huangguangda/repos",
"events_url": "https://api.github.com/users/huangguangda/events{/privacy}",
"received_events_url": "https://api.github.com/users/huangguangda/received_events",
"type": "User",
"site_admin": false
},
{
"login": "encoredw",
"id": 1918624,
"node_id": "MDQ6VXNlcjE5MTg2MjQ=",
"avatar_url": "https://avatars2.githubusercontent.com/u/1918624?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/encoredw",
"html_url": "https://github.com/encoredw",
"followers_url": "https://api.github.com/users/encoredw/followers",
"following_url": "https://api.github.com/users/encoredw/following{/other_user}",
"gists_url": "https://api.github.com/users/encoredw/gists{/gist_id}",
"starred_url": "https://api.github.com/users/encoredw/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/encoredw/subscriptions",
"organizations_url": "https://api.github.com/users/encoredw/orgs",
"repos_url": "https://api.github.com/users/encoredw/repos",
"events_url": "https://api.github.com/users/encoredw/events{/privacy}",
"received_events_url": "https://api.github.com/users/encoredw/received_events",
"type": "User",
"site_admin": false
},
...
]
```
user_following.json 👉 你关注的人
```json
[
{
"login": "dunwu",
"id": 19661255,
"node_id": "MDQ6VXNlcjE5NjYxMjU1",
"avatar_url": "https://avatars3.githubusercontent.com/u/19661255?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/dunwu",
"html_url": "https://github.com/dunwu",
"followers_url": "https://api.github.com/users/dunwu/followers",
"following_url": "https://api.github.com/users/dunwu/following{/other_user}",
"gists_url": "https://api.github.com/users/dunwu/gists{/gist_id}",
"starred_url": "https://api.github.com/users/dunwu/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/dunwu/subscriptions",
"organizations_url": "https://api.github.com/users/dunwu/orgs",
"repos_url": "https://api.github.com/users/dunwu/repos",
"events_url": "https://api.github.com/users/dunwu/events{/privacy}",
"received_events_url": "https://api.github.com/users/dunwu/received_events",
"type": "User",
"site_admin": false
},
{
"login": "fengdu78",
"id": 26119052,
"node_id": "MDQ6VXNlcjI2MTE5MDUy",
"avatar_url": "https://avatars1.githubusercontent.com/u/26119052?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/fengdu78",
"html_url": "https://github.com/fengdu78",
"followers_url": "https://api.github.com/users/fengdu78/followers",
"following_url": "https://api.github.com/users/fengdu78/following{/other_user}",
"gists_url": "https://api.github.com/users/fengdu78/gists{/gist_id}",
"starred_url": "https://api.github.com/users/fengdu78/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/fengdu78/subscriptions",
"organizations_url": "https://api.github.com/users/fengdu78/orgs",
"repos_url": "https://api.github.com/users/fengdu78/repos",
"events_url": "https://api.github.com/users/fengdu78/events{/privacy}",
"received_events_url": "https://api.github.com/users/fengdu78/received_events",
"type": "User",
"site_admin": false
}
]
```
user_repository.json 👉 你的仓库信息
```json
[
{
"id": 177291814,
"node_id": "MDEwOlJlcG9zaXRvcnkxNzcyOTE4MTQ=",
"name": "960-Grid-System",
"full_name": "kangvcar/960-Grid-System",
"private": false,
"owner": {
"login": "kangvcar",
"id": 20273349,
"node_id": "MDQ6VXNlcjIwMjczMzQ5",
"avatar_url": "https://avatars2.githubusercontent.com/u/20273349?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/kangvcar",
"html_url": "https://github.com/kangvcar",
"followers_url": "https://api.github.com/users/kangvcar/followers",
"following_url": "https://api.github.com/users/kangvcar/following{/other_user}",
"gists_url": "https://api.github.com/users/kangvcar/gists{/gist_id}",
"starred_url": "https://api.github.com/users/kangvcar/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/kangvcar/subscriptions",
"organizations_url": "https://api.github.com/users/kangvcar/orgs",
"repos_url": "https://api.github.com/users/kangvcar/repos",
"events_url": "https://api.github.com/users/kangvcar/events{/privacy}",
"received_events_url": "https://api.github.com/users/kangvcar/received_events",
"type": "User",
"site_admin": false
},
"html_url": "https://github.com/kangvcar/960-Grid-System",
"description": "The 960 Grid System is an effort to streamline web development workflow.",
"fork": true,
"url": "https://api.github.com/repos/kangvcar/960-Grid-System",
"forks_url": "https://api.github.com/repos/kangvcar/960-Grid-System/forks",
"keys_url": "https://api.github.com/repos/kangvcar/960-Grid-System/keys{/key_id}",
"collaborators_url": "https://api.github.com/repos/kangvcar/960-Grid-System/collaborators{/collaborator}",
"teams_url": "https://api.github.com/repos/kangvcar/960-Grid-System/teams",
"hooks_url": "https://api.github.com/repos/kangvcar/960-Grid-System/hooks",
"issue_events_url": "https://api.github.com/repos/kangvcar/960-Grid-System/issues/events{/number}",
"events_url": "https://api.github.com/repos/kangvcar/960-Grid-System/events",
"assignees_url": "https://api.github.com/repos/kangvcar/960-Grid-System/assignees{/user}",
"branches_url": "https://api.github.com/repos/kangvcar/960-Grid-System/branches{/branch}",
"tags_url": "https://api.github.com/repos/kangvcar/960-Grid-System/tags",
"blobs_url": "https://api.github.com/repos/kangvcar/960-Grid-System/git/blobs{/sha}",
"git_tags_url": "https://api.github.com/repos/kangvcar/960-Grid-System/git/tags{/sha}",
"git_refs_url": "https://api.github.com/repos/kangvcar/960-Grid-System/git/refs{/sha}",
"trees_url": "https://api.github.com/repos/kangvcar/960-Grid-System/git/trees{/sha}",
"statuses_url": "https://api.github.com/repos/kangvcar/960-Grid-System/statuses/{sha}",
"languages_url": "https://api.github.com/repos/kangvcar/960-Grid-System/languages",
"stargazers_url": "https://api.github.com/repos/kangvcar/960-Grid-System/stargazers",
"contributors_url": "https://api.github.com/repos/kangvcar/960-Grid-System/contributors",
"subscribers_url": "https://api.github.com/repos/kangvcar/960-Grid-System/subscribers",
"subscription_url": "https://api.github.com/repos/kangvcar/960-Grid-System/subscription",
"commits_url": "https://api.github.com/repos/kangvcar/960-Grid-System/commits{/sha}",
"git_commits_url": "https://api.github.com/repos/kangvcar/960-Grid-System/git/commits{/sha}",
"comments_url": "https://api.github.com/repos/kangvcar/960-Grid-System/comments{/number}",
"issue_comment_url": "https://api.github.com/repos/kangvcar/960-Grid-System/issues/comments{/number}",
"contents_url": "https://api.github.com/repos/kangvcar/960-Grid-System/contents/{+path}",
"compare_url": "https://api.github.com/repos/kangvcar/960-Grid-System/compare/{base}...{head}",
"merges_url": "https://api.github.com/repos/kangvcar/960-Grid-System/merges",
"archive_url": "https://api.github.com/repos/kangvcar/960-Grid-System/{archive_format}{/ref}",
"downloads_url": "https://api.github.com/repos/kangvcar/960-Grid-System/downloads",
"issues_url": "https://api.github.com/repos/kangvcar/960-Grid-System/issues{/number}",
"pulls_url": "https://api.github.com/repos/kangvcar/960-Grid-System/pulls{/number}",
"milestones_url": "https://api.github.com/repos/kangvcar/960-Grid-System/milestones{/number}",
"notifications_url": "https://api.github.com/repos/kangvcar/960-Grid-System/notifications{?since,all,participating}",
"labels_url": "https://api.github.com/repos/kangvcar/960-Grid-System/labels{/name}",
"releases_url": "https://api.github.com/repos/kangvcar/960-Grid-System/releases{/id}",
"deployments_url": "https://api.github.com/repos/kangvcar/960-Grid-System/deployments",
"created_at": "2019-03-23T13:23:53Z",
"updated_at": "2019-03-23T13:23:55Z",
"pushed_at": "2018-03-07T15:07:01Z",
"git_url": "git://github.com/kangvcar/960-Grid-System.git",
"ssh_url": "git@github.com:kangvcar/960-Grid-System.git",
"clone_url": "https://github.com/kangvcar/960-Grid-System.git",
"svn_url": "https://github.com/kangvcar/960-Grid-System",
"homepage": "http://960.gs",
"size": 3637,
"stargazers_count": 0,
"watchers_count": 0,
"language": "CSS",
"has_issues": false,
"has_projects": true,
"has_downloads": true,
"has_wiki": true,
"has_pages": false,
"forks_count": 0,
"mirror_url": null,
"archived": false,
"disabled": false,
"open_issues_count": 0,
"license": null,
"forks": 0,
"open_issues": 0,
"watchers": 0,
"default_branch": "master"
},
...
]
```
****
## QQ邮箱
!> **说明**:需登录账号 (建议扫码登录).
### 使用步骤
1. 点击**QQ邮箱**数据源按钮

2. 在弹出的浏览器中登录QQ邮箱(建议扫码登录)

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
qqmail_1.json 👉 你的QQ邮箱收信箱第一页数据
```json
[
{
"send_user": "no_reply",
"mailid": "ZC2702-CkApVu7KhFyaayd5XnupXa7",
"title": "Apple *********************icloud.com",
"time": "*****e5",
"email_addr": "no_reply@email.apple.com",
"content": "****************"
},
...
]
```
****
## 网易邮箱
!> **说明**:需登录账号 (建议扫码登录).
### 使用步骤
1. 点击**网易邮箱**数据源按钮

2. 在弹出的浏览器中登录网易邮箱(建议扫码登录)

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
wangyiemail_20.json 👉 你的126网易邮箱前20封邮件
```json
[
{
"mid": "239:1t*******",
"send_user": "[GitHub] A third-party GitHub Application has been added to your account",
"time": "2020-07-14 16:38:22",
"content": "***************************************************"
},
...
]
```
****
## 阿里邮箱
!> **说明**:需登录账号.
### 使用步骤
1. 点击**阿里邮箱**数据源按钮

2. 在弹出的浏览器中登录阿里邮箱

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
aliyun_mail.json 👉 你的阿里邮箱所有邮件
```json
[
{
"clientExtraInfo": {
"avatarRcp": {
"clientExtraInfo": {},
"displayEmail": "***@gmail.com",
"displayName": " *** ",
"email": "***@gmail.com",
"encDisplayEmail": "***@gmail.com",
"encDisplayName": "***",
"name": "****"
},
"encFullDisplayTime": "2020\u5e747\u670817\u65e5(\u661f\u671f\u4e94) 15:14",
"displaySize": "3KB",
"encDisplayTime": "15:14",
"encRcpLineContent": "*****"
},
"encSubject": "13",
"encSummary": "13",
"folderId": "2",
"from": {
"clientExtraInfo": {},
"displayEmail": "***@gmail.com",
"displayName": "***",
"email": "***@gmail.com",
"encDisplayEmail": "***@gmail.com",
"encDisplayName": "*****",
"name": "******"
},
"id": "DzzzzyUvf-h$---112z7wiM",
"mailId": "2_0:DzzzzyUvf-h$---112z7wiM",
"markedSubject": "13",
"owner": "***@aliyun.com",
"saveToSendFolder": true,
"separatedSend": false,
"sessionId": "DzzzzyUvf-h---112wtmq3",
"status": 4,
"subject": "13",
"tagList": [],
"timestamp": 1594970066000,
"to": [
{
"clientExtraInfo": {},
"displayEmail": "***@aliyun.com",
"displayName": "",
"email": "***@aliyun.com",
"encDisplayEmail": "****@aliyun.com",
"encDisplayName": "",
"name": ""
}
]
},
...
]
```
****
## 新浪邮箱
!> **说明**:需登录账号.
### 使用步骤
1. 点击**新浪邮箱**数据源按钮

2. 在弹出的浏览器中登录新浪邮箱

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
sina_1.json 👉 你的新浪邮箱第一页所有邮件
```json
[
{
"mid": "043F7CE6001807666676A0F28FCF4914800220000001",
"title": "Fwd: Buy Your Logo and Save $5 USD Now [Time-Limited]",
"send_user": "126 *******@126.com>",
"email_addr": "*******@@sina.cn",
"content_json": {
"result": true,
"errno": 0,
"msg": "",
"data": {
"actual_sender": "",
"from": "126 <<*******@@126.com>",
"to": "*******@@sina.cn",
"cc": "",
"bcc": "",
"date": 1594922100,
"subject": "Fwd: Buy Your Logo and Save $5 USD Now [Time-Limited]",
"priority": false,
"notification_to": false,
"xmsgid": "",
"isstar": false,
"size": 9740,
"body": "*******@",
"ishtml": true,
"attlist": [],
"mid": "043F7CE6001807666676A0F28FCF49148000*******@001",
"fid": "new",
"sendstatus": null,
"neednotify": false
}
}
},
...
]
```
****
## Hotmail/Outlook邮箱
!> **说明**:需登录账号.
### 使用步骤
1. 点击**Hotmail**数据源按钮

2. 在弹出的浏览器中登录Hotmail/Outlook邮箱

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
hotmail.json 👉 你的Hotmail/Outlook邮箱所有邮件
```json
[
{
"send_user": "***@gmail.com",
"title": "Welcome to Disqus, ******!",
"time": "11:05",
"content": "Forwarded message - Disqus Date: 2020 Subject: Welcome to Disqus****"
},
{
"send_user": "***@gmail.com",
"title": "********",
"time": "11:05",
"content": "*****************"
},
...
]
```
***
## 京东
!> **说明**:需登录账号 (建议扫码登录).
### 使用步骤
1. 点击**京东**数据源按钮

2. 在弹出的浏览器中登录京东(建议扫码登录)

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
addr.json 👉 你的地址信息
```json
[
{
"name": "************",
"addr": "************",
"detail_addr": "************",
"mobile": "13*********",
"tel": "************",
"email": "************"
},
...
]
```
creditData.json 👉 你的信用数据
```json
{
"isOverdue": 0,
"totalDebt": 0.00,
"creditLimit": 1000.00,
"jtTotalDebt": "0.00",
"jtCreditLimit": "0.00",
"tourCreditLimit": 1000.00,
"actStatus": 3,
"jieqianActStatus": 2,
"creditWaitPaySeven": "0.00",
"creditWaitPayPercent": 0,
"tourCreditWaitPaySeven": 0.00,
"jtAvailableLimit": "0.00",
"availableLimit": 1000.00,
"jtCreditWaitPay": "0.00",
"tourCreditWaitPayPercent": 0,
"tourActStatus": 3,
"creditWaitPay": "0.00",
"tourTotalDebt": "0.00",
"tourCreditWaitPay": 0.00,
"jtCreditWaitPaySeven": "0.00",
"delinquencyBalance": "0.00",
"jtCreditWaitPayPercent": 0,
"jtDelinquencyBalance": "0.00",
"tourDelinquencyBalance": 0.00,
"jtActStatus": 2,
"tourAvailableLimit": 1050.00
}
```
finance_income.json 👉 你的收入信息
```json
{
"data": {
"incomeYes": 0,
"incomeTotal": 0.00,
"holdAmount": null,
"incomeToday": null
}
}
```
follow_products.json 👉 你关注的商品信息
```json
[
{
"name": "Redmi 10X 5G ******",
"url": "******",
"price": "1599.00",
"status": "100%"
},
...
]
```
follow_shops.json 👉 你关注的店铺信息
```json
[
{
"name": "**********",
"url": "//honor.jd.com"
},
...
]
```
income.json 👉 你每天的收入信息
```json
{
"maxIncome": 10,
"incomeData": [
{
"date": "2020-05-10",
"income": 0
},
{
"date": "2020-05-11",
"income": 0
},
...
]
}
```
jd_orders_2018.json 👉 你2018年的所有订单信息
```json
[
{
"mainProductId": 0,
"wareType": 0,
"jiFen": 0,
"stock": 5,
"cardKey": null,
"discountPrice": 0,
"stockName": null,
"singleShouldPrice": null,
"jingDouNum": 0,
"cid": 0,
"price": null,
"imgPath": "//img10.360buyimg.com/N6/s60x60_jfs/t1/59734/28/571/259980/5ced2888E43337972/5c882bf17abbcd2b.jpg",
"productId": 1914332,
"num": 0,
"wareUrl": "//item.jd.com/1914332.html",
"categoryString": "670;686;689",
"secondHandNameAndUrl": "\u5356\u4e86\u6362\u94b1,//huishou.paipai.com",
"snCode": null,
"yb": false,
"isShowHuiShouJiuJiLink": 0,
"showSellForMoneyLink": 1,
"cxlFlag": 0,
"dynamicIcon": 0,
"giftWare": false,
"color": null,
"name": "\u7f57\u6280\uff08Logitech\uff09K380 \u952e\u76d8 \u65e0\u7ebf\u84dd\u7259\u952e\u76d8 \u529e\u516c\u952e\u76d8 \u5973\u6027 \u4fbf\u643a \u8d85\u8584\u952e\u76d8 \u7b14\u8bb0\u672c\u952e\u76d8 \u6df1\u7070\u8272",
"state": 1,
"goods-number": "",
"consignee tooltip": "",
"amount": "",
"order-shop": ""
},
...
]
```
jiaoyi_bill.json 👉 你的发票信息
```json
{
"resultList": {
"list": [],
"totalPage": 3,
"count": 3
},
"account_merged": 2,
"pageView": {
"list": [],
"totalPage": 0,
"count": 0
},
"pin": "jd_404e59e6f8dd8",
"resultCount": 3
}
```
user_info.json 👉 你的个人基本信息
```json
[
{
"isAuthenticated": 1,
"userNickName": "ddddddr",
"userRank": "Diamonds",
"isEmploy": 0,
"isStudent": 1,
"flagInfo": "10000000000003303000000000010500100100002000006300001000000080000000000000000000000000000000000000",
"headImg": "http://storage.360buyimg.com/i.imageUpload/6a645f3430346535396536dd1363831353232323232343432393732_mid.jpg",
"jdScore": "1114",
"plusStage": "TRYEXPIRE"
}
]
```
wallet.json 👉 你的钱包信息
```json
{
"data": {
"walletMoney": 1.00,
"freezeMoney": 0.00,
"walletMoneyAvailable": 1.00,
"balance": 0,
"balanceFreeze": 0,
"balanceAvailable": 0,
"currIncome": 0.00,
"totalIncome": 0.00,
"borrow": 0,
"investAmount": null,
"totalMoney": 1.00,
"rate": 0.00,
"currency": null,
"fundIncome": 0.00,
"finance": 0.00,
"fund": 0.00,
"billoanKeep": 0,
"insuranceKeep": 0,
"bankKeep": 0,
"fundsKeep": 0,
"incomeSumYesterday": 0.00,
"incomeTotal": 0.00,
"incomeFinanceYesterday": 0,
"incomeFinanceSum": 0.00,
"p2pAmount": 0,
"trustAmount": 0,
"firmFinance": 0,
"secondaryAmount": 0,
"lastestIncomeFlag": "0",
"lecaiAmount": null,
"stockAmount": 0,
"jgtAmount": 0,
"cmaAmount": 0,
"pensionAmount": null,
"gdScrtKeep": 0,
"ztAmount": 0,
"mmlc": 0,
"balancePercent": 0,
"fundPercent": 0,
"walletMoneyAvailablePercent": 100
},
"enableProof": "enable",
"pick": "****"
}
```
****
## 淘宝
!> **说明**:需登录账号 (建议扫码登录).
### 使用步骤
1. 点击**淘宝**数据源按钮

2. 在弹出的浏览器中登录淘宝(建议扫码登录)

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
addr.json 👉 你的淘宝地址信息
```json
[
{
"name": [
"**********"
],
"area": [
"*************************"
],
"detail_area": [
"*************************"
],
"youbian": [
"*****"
],
"mobile": [
"13**********"
]
},
...
]
```
addr.json 👉 你的淘宝收藏商品信息
```json
[
{
"title": "4G\u5168\u7f51\u901aNokia/\u8bfa\u57fa\u4e9a\u65b0106\u8001\u4eba\u673a\u79fb\u52a8\u7535\u4fe1\u7248\u8d85\u957f\u5f85\u673a\u5b66\u751f\u6309\u952e\u529f\u80fd\u5927\u5b57\u5927\u58f0\u8001\u5e74\u513f\u7ae5\u7ecf\u5178\u5c0f\u624b\u673a\u5b98\u65b9\u65d7\u8230\u5e97220",
"url": "//item.taobao.com/item.htm?id=585241267088&_u=t2dmg8j26111",
"price": "\u00a5119.00\u00a5199.00"
},
...
]
```
addr.json 👉 你的淘宝浏览足迹信息
```json
[
{
"date": "2020-07-16",
"url": "//item.taobao.com/item.htm?scm=1007.13982.82927.0&id=591107748490&last_time=1594896161",
"name": "\u5c0f\u7c73Qin1s\u591a\u4eb2ai\u624b\u673a\u79fb\u52a8\u8054\u901a4G\u7535\u4fe1\u8001\u4eba\u667a\u80fd\u5c0f\u7231\u540c\u5b66\u751f\u6309\u952e\u624b\u673a",
"price": "\u00a5299\u00a5299.0"
},
...
]
```
addr.json 👉 你的淘宝订单信息
```json
[
"2020-07-15\u8ba2\u5355\u53f7:608693548110926703",
"\u521b\u4e8e\u4f73\u8baf\u6570\u7801\u4e13\u8425\u5e97",
"\u30104G\u5168\u7f51\u901a\u3011\u7ebd\u66fc M560\u6b63\u54c1\u8001\u4eba\u673a\u8d85\u957f\u5f85\u673a\u76f4\u677f\u8001\u5e74\u624b\u673a\u5927\u5c4f\u5927\u5b57\u5927\u58f0\u97f3\u79fb\u52a8\u8054\u901a\u7535\u4fe1\u7248\u5973\u5c0f\u5b66\u751f\u6309\u952e\u667a\u80fd\u624b\u673a[\u4ea4\u6613\u5feb\u7167]\u673a\u8eab\u989c\u8272\uff1a\u7ea2\u8272\u5957\u9910\u7c7b\u578b\uff1a\u5b98\u65b9\u6807\u914d\u5b58\u50a8\u5bb9\u91cf\uff1a256MB\u7248\u672c\u7c7b\u578b\uff1a\u3010\u9876\u914d\u7248\u3011\u79fb\u52a8/\u8054\u901a2.8\u82f1\u5bf8\u5c4f \uffe5528.00\uffe595.00 1 \u589e\u503c\u670d\u52a1\uff1a\u5168\u56fd\u8054\u4fdd \uffe50.00 1",
"\uffe5528.00\uffe595.00 \uffe592.00 \uffe50.00"
]
```
****
## 支付宝
!> **说明**:需登录账号 (建议扫码登录).
### 使用步骤
1. 点击**支付宝**数据源按钮

2. 在弹出的浏览器中登录支付宝(建议扫码登录)

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
addr.json 👉 你的支付宝个人信息
```json
{
"name": "**********",
"email": "**********",
"mobile": "**********",,
"tb_name": "**********",,
"register_time": "2015**********",
}
```
addr.json 👉 你的支付宝余额信息
```json
{
"YuE": "0.00"
}
```
addr.json 👉 你的支付宝账单信息
```json
[
{
"number": "202007***0149183*****",
"time": "2020-07-10 12:25:25",
"info": "*****5063938600101",
"income": "",
"outcome": "- 16150.00",
"balance": "0.00",
"from": "******",
"detail": "*******"
},
...
]
```
addr.json 👉 你的余额宝信息
```json
{
"eye-val": "290.91",
"total_val": "291.93",
"Unavailable_val": "1.02"
}
```
****
## 中国移动
!> **说明**:需登录账号 (建议扫码登录).
### 使用步骤
1. 点击**中国移动**数据源按钮

2. 在弹出的浏览器中登录中国移动

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
yidong_bill.json 👉 你的中国移动账单信息
```json
{
"202007": [],
"202006": [
{
"remark": null,
"itemName": "38\u51434G\u98de\u4eab\u5957\u9910\u9752\u6625\u7248",
"itemValue": "38.00"
},
{
"remark": null,
"itemName": "\u624b\u673a\u5bbd\u5e2690\u5143\u6708\u79df\u5957\u9910\uff08\u7701\u7edf\uff09",
"itemValue": "0.00"
},
{
"remark": null,
"itemName": "50M\u53ca\u4ee5\u4e0b\u5bbd\u5e26\u8425\u9500\u4f18\u60e0",
"itemValue": "10.00"
}
],
"202005": [
{
"remark": null,
"itemName": "38\u51434G\u98de\u4eab\u5957\u9910\u9752\u6625\u7248",
"itemValue": "38.00"
},
{
"remark": null,
"itemName": "\u624b\u673a\u5bbd\u5e2690\u5143\u6708\u79df\u5957\u9910\uff08\u7701\u7edf\uff09",
"itemValue": "0.00"
},
{
"remark": null,
"itemName": "50M\u53ca\u4ee5\u4e0b\u5bbd\u5e26\u8425\u9500\u4f18\u60e0",
"itemValue": "10.00"
}
],
...
}
```
****
## 中国联通
!> **说明**:需登录账号 (建议扫码登录).
### 使用步骤
1. 点击**中国联通**数据源按钮

2. 在弹出的浏览器中登录中国联通(建议扫码登录)

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
10010_user_info.json 👉 你的中国联通号码个人信息
```json
{
"userInfo": {
"province": "051",
"custlvl": "二星用户",
"loginType": "01",
"currentId": "13*********",
"is_vip": null,
"mobile": "13*********",
"packageName": "沃派流量王",
"vip_level": null,
"openDate": "2015091923344",
"userNettype": "4G"
},
"userinfo": {
"currentID": "13*********",
"nettype": "11",
"paytype": "2",
"provincecode": "051",
"usernumber": "13*********",
"citycode": "510",
"loginType": "01",
"customid": "30150925335984",
"certtype": "11",
"packageName": "沃派流量王",
"expireTime": "15943333237",
"areaCode": "",
"custlvl": "二星用户",
"certnum": "4408****102294",
"opendate": "2015033314444",
"productId": "13*********",
"packageID": "90473386",
"custName": "***",
"certaddr": "广东**********",
"brand": "4G00",
"productType": "01",
"subscrbstat": "开通",
"is_wo": "2",
"nickName": "13*****",
"laststatdate": "",
"brand_name": "沃4G后付费",
"is_20": false,
"is_36": false,
"verifyState": "",
"encryptCert": "ZiYUb9xdQaaaaSSPcGtOwwzjJadt5dPA5DgL8p8eNyFBq/CcWoJ/wY9XWmqysBS6BO0i6BHnN4RtoQAZcX+9+G8OYsgp8TCUtnmhMOyzA7VvCq20lmy0RKGUCDT7cRHlX2ewe4REPNmy1ETu2Vyxw/BQZqpeg2oP4u8cIzPk=",
"loginCustid": "30150a465984",
"lastLoginTime": "2020-07-16 01:42:37",
"defaultFlag": "00",
"isINUser": "0000",
"mapExtraParam_rls": "16",
"custsex": "1",
"natureQueryNumberInfo": {
"rsp_code": "7057",
"rsp_desc": "用户未登录"
},
"status": "开通"
}
}
```
10010_bill_info.json 👉 你的中国联通号码账单信息
```json
{
"errormessage": null,
"emptLineMap": {
"col2": [
0,
0
],
"col0": [],
"col1": [
0,
0
]
},
"userInfo": {
"usernumber": "13*********",
"currentID": "13*********",
"nettype": "11",
"paytype": "2",
"provincecode": "051",
"citycode": "510",
"loginType": "01",
"customid": "3015092568411984",
"packageName": "沃派流量王",
"subscrbstat": "开通",
"certtype": "11",
"expireTime": "1594842811237",
"areaCode": "",
"custlvl": "二星用户",
"certnum": "44*********",
"opendate": "201*****4",
"productId": "13*********",
"packageID": "904***6",
"custName": "***",
"certaddr": "广东**********",
"brand": "4G00",
"productType": "01",
"is_wo": "2",
"nickName": "132********",
"laststatdate": "",
"brand_name": "沃4G后付费",
"is_20": false,
"is_36": false,
"encryptCert": "ZiYUb9xdQ9azZPQ3aaGtOwwzjJadt5dPA5DgL8p8eNyFBq/CcWoJ/wY9XWmqysBS6BO0i6BHnN4RtoQAZcX+9+G8OYsgp8TCUtnmhMOyzA7VvCq20lmy0RKGUCDT7cRHlX2ewe4REPNmy1ETu2Vyxw/BQZqpeg2oP4u8cIzPk=",
"natureQueryNumberInfo": {
"rsp_code": "7057",
"rsp_desc": "用户未登录"
},
"verifyState": "",
"loginCustid": "3015092522265984",
"lastLoginTime": "2020-07-16 01:42:37",
"defaultFlag": "00",
"isINUser": "0000",
"mapExtraParam_rls": "16",
"custsex": "1",
"status": "开通"
},
"separateShow": true,
"totalMonthData": [
{
"fee": "47.10",
"cycleid": "201907"
},
{
"fee": "39.00",
"cycleid": "201908"
},
{
"fee": "43.00",
"cycleid": "201909"
},
{
"fee": "54.60",
"cycleid": "201910"
},
{
"fee": "50.65",
"cycleid": "201911"
},
{
"fee": "40.95",
"cycleid": "201912"
},
{
"fee": "46.80",
"cycleid": "202001"
},
{
"fee": "43.65",
"cycleid": "202002"
},
{
"fee": "45.65",
"cycleid": "202003"
},
{
"fee": "39.00",
"cycleid": "202004"
},
{
"fee": "39.00",
"cycleid": "202005"
},
{
"fee": "39.00",
"cycleid": "202006"
}
],
"billList": [
{
"leve": "",
"lineSize": 2,
"amount": "39.00",
"discnt": "",
"integrateItemCode": "1001",
"allLineCount": 2,
"usedCount": "--",
"lines": [
{
"leve": "-",
"lineSize": 1,
"amount": "39.00",
"discnt": "",
"integrateItemCode": "21229",
"allLineCount": 1,
"usedCount": "--",
"lines": [],
"childCount": 0,
"name": "基本套餐费"
}
],
"childCount": 1,
"name": "月固定费"
}
],
"datList": [
{
"dat": "202006",
"datfmt": "2020年06月",
"cls": "on"
},
{
"dat": "202005",
"datfmt": "2020年05月"
},
{
"dat": "202004",
"datfmt": "2020年04月"
},
{
"dat": "202003",
"datfmt": "2020年03月"
},
{
"dat": "202002",
"datfmt": "2020年02月"
},
{
"dat": "202001",
"datfmt": "2020年01月"
},
{
"dat": "201912",
"datfmt": "2019年12月"
},
{
"dat": "201911",
"datfmt": "2019年11月"
},
{
"dat": "201910",
"datfmt": "2019年10月"
},
{
"dat": "201909",
"datfmt": "2019年09月"
},
{
"dat": "201908",
"datfmt": "2019年08月"
},
{
"dat": "201907",
"datfmt": "2019年07月"
}
],
"isDiscount": "",
"result": {
"cycleId": "202006",
"balance": "0.00",
"areaCode": "0020",
"scoreInfo": [
{
"rsRvScoreAdjust": "0",
"rsRvScore3": "0",
"rsRvScore2": "0",
"rsRvScore1": "0",
"scoreUseValue": "0",
"scoreIdleValue": "0"
}
],
"userId": "511906225022244",
"billInfo": [
{
"fee": "39.00",
"balance": "",
"discnt": "",
"parentItemCode": "-1",
"integrateItemCode": "1001",
"integrateItem": "月固定费",
"usedValue": "",
"adjustAfter": "",
"adjustBefore": ""
},
{
"fee": "39.00",
"balance": "",
"discnt": "",
"parentItemCode": "1001",
"integrateItemCode": "21229",
"integrateItem": "基本套餐费",
"usedValue": "",
"adjustAfter": "",
"adjustBefore": ""
},
{
"fee": "0.00",
"balance": "",
"discnt": "",
"parentItemCode": "-1",
"integrateItemCode": "1002",
"integrateItem": "增值业务费",
"usedValue": "",
"adjustAfter": "",
"adjustBefore": ""
},
{
"fee": "0.00",
"balance": "",
"discnt": "",
"parentItemCode": "1002",
"integrateItemCode": "436789",
"integrateItem": "增值业务-绿色邮箱",
"usedValue": "",
"adjustAfter": "",
"adjustBefore": ""
}
],
"allFee": "39.00",
"acctClass": [
{
"fee": "47.10",
"cycleid": "201907"
},
{
"fee": "39.00",
"cycleid": "201908"
},
{
"fee": "43.00",
"cycleid": "201909"
},
{
"fee": "54.60",
"cycleid": "201910"
},
{
"fee": "50.65",
"cycleid": "201911"
},
{
"fee": "40.95",
"cycleid": "201912"
},
{
"fee": "46.80",
"cycleid": "202001"
},
{
"fee": "43.65",
"cycleid": "202002"
},
{
"fee": "45.65",
"cycleid": "202003"
},
{
"fee": "39.00",
"cycleid": "202004"
},
{
"fee": "39.00",
"cycleid": "202005"
},
{
"fee": "39.00",
"cycleid": "202006"
}
],
"writeOffFee": "39.00",
"recvFeeUsed": "19.00",
"presentFeeUsed": "20.00",
"derateFee": "0.00",
"resultMemo": "备注信息",
"adjustFee": "0.00",
"backFee": "0.00",
"actionFeeUsed": "0.00",
"serialNumber": "13*********",
"success": true,
"respDesc": "成功",
"busiOrder": "BUSI042007160156330229073405",
"respCode": "0000"
},
"score": {
"usableScore": 0,
"curAddScore": 0,
"usedScore": 0
},
"success": true,
"curDate": "202006",
"queryTime": "查询时间:2020年07月16日 02:00:26",
"isForTotal": "",
"LoginType": "01",
"groupInfo": null
}
```
***
## 知乎
!> **说明**:无需登录账号, 输入知乎用户名(必须英文名)即可 (如 kangvcar ) .
### 使用步骤
1. 点击**知乎**数据源按钮

2. 输入知乎用户名(必须英文名)

3. 选择数据保存路径

?> 👍 数据源的爬取可能会生成多个文件, 所以建议新建一个文件夹来保存数据.
4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
user_profile.json 👉 你的个人基本信息
```json
{
"id": "f75519c320c28eb190fe35dede8fe37e",
"url_token": "gao-nan-bao",
"name": "���ѱ�",
"use_default_avatar": false,
"avatar_url": "https://pic4.zhimg.com/v2-6bb2bb11b7fb1c4883f36731f42f7537_l.jpg",
"avatar_url_template": "https://pic2.zhimg.com/v2-6bb2bb11b7fb1c4883f36731f42f7537.jpg",
"is_org": false,
"type": "people",
"url": "https://www.zhihu.com/api/v4/people/gao-nan-bao",
"user_type": "people",
"headline": "���ڴ�ҵ�ߣ����ںţ����ѱ�",
"gender": 1,
"is_advertiser": false,
"vip_info": {
"is_vip": true,
"rename_days": "60",
"widget": {
"url": "https://pic4.zhimg.com/v2-a9b03166fb595ff0ced2e8fa668d3267_r.png",
"night_mode_url": "https://pic1.zhimg.com/v2-d2ac78ddc5a342b8dbf964843e9dcb5e_r.png"
},
"vip_icon": {
"url": "https://pic2.zhimg.com/v2-4812630bc27d642f7cafcd6cdeca3d7a_r.png",
"night_mode_url": "https://pic3.zhimg.com/v2-c9686ff064ea3579730756ac6c289978_r.png"
}
},
"is_realname": true
}
```
user_followers.json 👉 你的粉丝信息
```json
{
"paging": {
"is_end": false,
"is_start": true,
"next": "https://www.zhihu.com/api/v4/members/gao-nan-bao/followers?limit=10\u0026offset=10",
"previous": "https://www.zhihu.com/api/v4/members/gao-nan-bao/followers?limit=10\u0026offset=0",
"totals": 37680
},
"data": [
{
"id": "a4f0588f511a8db606ad03e65d917b4b",
"url_token": "liu-yong-qing-39",
"name": "��ӽ��",
"use_default_avatar": true,
"avatar_url": "https://pic4.zhimg.com/da8e974dc_l.jpg",
"avatar_url_template": "https://pic2.zhimg.com/da8e974dc.jpg",
"is_org": false,
"type": "people",
"url": "https://www.zhihu.com/api/v4/people/liu-yong-qing-39",
"user_type": "people",
"headline": "����",
"gender": -1,
"is_advertiser": false,
"vip_info": {
"is_vip": false,
"rename_days": "60"
},
"is_realname": true
},
{
"id": "aab834629480a04b19729afb8ff47f0b",
"url_token": "piao-yang-guo-hai-lai-kan-ta",
"name": "����˼����",
"use_default_avatar": false,
"avatar_url": "https://pic1.zhimg.com/v2-f5c750836f02843b825094c12bcc0758_l.jpg",
"avatar_url_template": "https://pic3.zhimg.com/v2-f5c750836f02843b825094c12bcc0758.jpg",
"is_org": false,
"type": "people",
"url": "https://www.zhihu.com/api/v4/people/piao-yang-guo-hai-lai-kan-ta",
"user_type": "people",
"headline": "��ѩ��裬�������ģ���ҵƻ������ҡ�",
"gender": 1,
"is_advertiser": false,
"vip_info": {
"is_vip": false,
"rename_days": "60"
},
"is_realname": true
},
...
]
}
```
user_followees.json 👉 你关注的人
```json
{
"paging": {
"is_end": false,
"is_start": true,
"next": "https://www.zhihu.com/api/v4/members/gao-nan-bao/followees?limit=10\u0026offset=10",
"previous": "https://www.zhihu.com/api/v4/members/gao-nan-bao/followees?limit=10\u0026offset=0",
"totals": 87
},
"data": [
{
"id": "712586f396682c148a2e340d612154d0",
"url_token": "xing-ya-ke-ji",
"name": "���ĿƼ�",
"use_default_avatar": false,
"avatar_url": "https://pic4.zhimg.com/v2-f8fd2769c70da0f1f9063a5c1be1b3b3_l.jpg",
"avatar_url_template": "https://pic2.zhimg.com/v2-f8fd2769c70da0f1f9063a5c1be1b3b3.jpg",
"is_org": true,
"type": "people",
"url": "https://www.zhihu.com/api/v4/people/xing-ya-ke-ji",
"user_type": "organization",
"headline": "���ĿƼ�--�ƶ���������Ӫ��רҵ�����̣��ţ�pbi365",
"gender": -1,
"is_advertiser": false,
"vip_info": {
"is_vip": false,
"rename_days": "60"
},
"is_realname": true
},
{
"id": "aa7710b9edf3f4eacb4ceb9c97423468",
"url_token": "xiao-rui-xuan-1998",
"name": "��Rosheen",
"use_default_avatar": false,
"avatar_url": "https://pic1.zhimg.com/v2-31f9d878d451ab3d3cac9668980ace2c_l.jpg",
"avatar_url_template": "https://pic3.zhimg.com/v2-31f9d878d451ab3d3cac9668980ace2c.jpg",
"is_org": false,
"type": "people",
"url": "https://www.zhihu.com/api/v4/people/xiao-rui-xuan-1998",
"user_type": "people",
"headline": "�����������ٴ��� Ω�۲��˰ѵ��̡�",
"gender": -1,
"is_advertiser": false,
"vip_info": {
"is_vip": false,
"rename_days": "60"
},
"is_realname": true
},
...
]
}
```
user_articles.json 👉 你发布的文章信息
```json
{
"paging": {
"is_end": false,
"totals": 54,
"previous": "http://www.zhihu.com/api/v4/members/gao-nan-bao/articles?limit=10&offset=0",
"is_start": true,
"next": "http://www.zhihu.com/api/v4/members/gao-nan-bao/articles?limit=10&offset=10"
},
"data": [
{
"updated": 1594140929,
"copyright_permission": "need_review",
"excerpt": "\u4e0d\u77e5\u9053\u4ec0\u4e48\u65f6\u5019\u8c03\u6574\u3001\u4e0d\u77e5\u9053\u8c03\u6574\u5e45\u5ea6\uff0c\u4e0d\u77e5\u9053\u4f1a\u6da8\u591a\u9ad8\uff0c\u4e0d\u77e5\u9053\u4f1a\u6da8\u591a\u4e45\u3002\u4f46\u770b\u4e86\u8fd9\u4e48\u591a\u5e74\u800d\u628a\u620f\uff0c\u77e5\u9053\u5927\u6982\u7684\u800d\u6cd5\uff1a\u4e00\u3001\u4efb\u4f55\u4e00\u8f6e\u884c\u60c5\uff0c\u5728\u8d77\u6b65\u9636\u6bb5\uff0c\u5148\u662f\u4e00\u6e9c\u5c0f\u788e\u6b65\uff0c\u5c31\u50cf\u52a9\u8dd1\u4f3c\u7684\uff1b\u7136\u540e\uff0c\u4ee5\u201c\u8f67\u7a7a\u201d\u65b9\u5f0f\u62c9\u8d77\uff0c\u8ba9\u90a3\u4e9b\u6ca1\u4e0a\u8f66\u7684\u54e5\u4eec\u5931\u671b\u3002\u653e\u4e86\u5de8\u91cf\uff0c\u4ee5\u4e3a\u8981\u8c03\u6574\uff0c\u2026",
"excerpt_title": "",
"id": 157657746,
"linkbox": {
"url": "",
"category": "",
"pic": "",
"title": ""
},
"author": {
"is_followed": false,
"avatar_url_template": "https://pic2.zhimg.com/v2-6bb2bb11b7fb1c4883f36731f42f7537_{size}.jpg",
"type": "people",
"name": "\u9ad8\u96be\u9971",
"url": "http://www.zhihu.com/api/v4/people/f75519c320c28eb190fe35dede8fe37e",
"gender": 1,
"user_type": "people",
"url_token": "gao-nan-bao",
"is_advertiser": false,
"avatar_url": "https://pic2.zhimg.com/v2-6bb2bb11b7fb1c4883f36731f42f7537_is.jpg",
"is_following": false,
"is_org": false,
"headline": "\u91d1\u878d\u4ece\u4e1a\u8005\uff0c\u516c\u4f17\u53f7\uff1a\u9ad8\u96be\u9971",
"badge": [
{
"type": "identity",
"description": "\u590d\u65e6\u5927\u5b66 \u7ecf\u6d4e\u5b66\u7855\u58eb"
}
],
"id": "f75519c320c28eb190fe35dede8fe37e"
},
"url": "http://zhuanlan.zhihu.com/p/157657746",
"comment_permission": "all",
"created": 1594140929,
"image_width": 597,
"comment_count": 12,
"voteup_count": 53,
"image_url": "https://pic1.zhimg.com/v2-e0a7b7378fd937f85a4c907be1472778_r.jpg",
"title": "\u5927\u76d8\u4ec0\u4e48\u65f6\u5019\u8c03\u6574\uff1f",
"can_comment": {
"status": true,
"reason": ""
},
"type": "article",
"suggest_edit": {
"status": false,
"url": "",
"reason": "",
"tip": "",
"title": ""
}
},
{
"updated": 1592988438,
"copyright_permission": "need_review",
"excerpt": "\u4e0d\u5c11\u4f19\u8ba1\u51ed\u76f4\u89c2\u7ecf\u9a8c\u8ba4\u4e3a\uff0c\u8d27\u5e01\u653f\u7b56\u5bbd\u677e\uff0c\u653e\u6c34\uff0c\u80a1\u5e02\u5c31\u6da8\uff1b\u8d27\u5e01\u653f\u7b56\u6536\u7d27\uff0c\u5e02\u573a\u94b1\u5c11\u4e86\uff0c\u6216\u8005\u8d44\u91d1\u7684\u6210\u672c\u9ad8\u4e86\uff0c\u80a1\u5e02\u5c31\u8dcc\u3002\u8fd9\u6bb5\u65f6\u95f4\u51fa\u73b0\u201c\u53cd\u5e38\u73b0\u8c61\u201d\uff1a\u80a1\u7968\u4e00\u76f4\u5728\u6da8\uff0c\u540c\u65f6\u8d27\u5e01\u4e0d\u518d\u7ee7\u7eed\u5bbd\u677e\uff0c\u6d41\u52a8\u6027\u51fa\u73b0\u4e00\u5b9a\u7a0b\u5ea6\u7d27\u7f29\u3002\u8fd9\u662f\u600e\u4e48\u56de\u4e8b\u5462\uff1f \u4e00<\/b> \u80a1\u7968\u5728\u6da8<\/b> \u6caa\u6df1300\u3001\u521b\u4e1a\u2026",
"excerpt_title": "",
"id": 150390300,
"linkbox": {
"url": "",
"category": "",
"pic": "",
"title": ""
},
"author": {
"is_followed": false,
"avatar_url_template": "https://pic2.zhimg.com/v2-6bb2bb11b7fb1c4883f36731f42f7537_{size}.jpg",
"type": "people",
"name": "\u9ad8\u96be\u9971",
"url": "http://www.zhihu.com/api/v4/people/f75519c320c28eb190fe35dede8fe37e",
"gender": 1,
"user_type": "people",
"url_token": "gao-nan-bao",
"is_advertiser": false,
"avatar_url": "https://pic2.zhimg.com/v2-6bb2bb11b7fb1c4883f36731f42f7537_is.jpg",
"is_following": false,
"is_org": false,
"headline": "\u91d1\u878d\u4ece\u4e1a\u8005\uff0c\u516c\u4f17\u53f7\uff1a\u9ad8\u96be\u9971",
"badge": [
{
"type": "identity",
"description": "\u590d\u65e6\u5927\u5b66 \u7ecf\u6d4e\u5b66\u7855\u58eb"
}
],
"id": "f75519c320c28eb190fe35dede8fe37e"
},
"url": "http://zhuanlan.zhihu.com/p/150390300",
"comment_permission": "all",
"created": 1592942731,
"image_width": 1649,
"comment_count": 17,
"voteup_count": 28,
"image_url": "https://pic2.zhimg.com/v2-04032161f01e347abc7fd8332252a719_r.jpg",
"title": "\u8d27\u5e01\u4e0d\u518d\u7ee7\u7eed\u5bbd\u677e\uff0c\u80a1\u5e02\u4e3a\u4ec0\u4e48\u4e0a\u6da8\uff1f",
"can_comment": {
"status": true,
"reason": ""
},
"type": "article",
"suggest_edit": {
"status": false,
"url": "",
"reason": "",
"tip": "",
"title": ""
}
},
...
]
}
```
user_activities.json 👉 你的动态信息
```json
{
"paging": {
"is_end": false,
"next": "https://www.zhihu.com/api/v4/members/gao-nan-bao/activities?limit=7&session_id=1594710001368&after_id=1594563543&desktop=True",
"previous": "https://www.zhihu.com/api/v4/members/gao-nan-bao/activities?before_id=1594700136&limit=7&session_id=1594710001368&desktop=True"
},
"data": [
{
"target": {
"author": {
"headline": "",
"avatar_url": "https://pic4.zhimg.com/aadd7b895_s.jpg",
"name": "\u533f\u540d\u7528\u6237",
"url": "",
"url_token": "",
"type": "people",
"user_type": "people",
"id": "0"
},
"relationship": {
"is_author": false,
"is_following": false
},
"created": 1519303241,
"url": "https://api.zhihu.com/questions/267534527",
"title": "\u57fa\u91d1\u5b9a\u6295\u8fd9\u4e48\u597d\uff0c\u4e3a\u4ec0\u4e48\u80fd\u575a\u6301\u4e0b\u6765\u7684\u4eba\u90a3\u4e48\u5c11\uff1f",
"excerpt": "\u539f\u6587\uff1a\u57fa\u91d1\u5b9a\u6295\u8fd9\u4e48\u597d\uff0c\u4e3a\u4ec0\u4e48\u80fd\u575a\u6301\u4e0b\u6765\u7684\u4eba\u90a3\u4e48\u5c11\uff1f ",
"detail": "\u539f\u6587\uff1a\u57fa\u91d1\u5b9a\u6295\u8fd9\u4e48\u597d\uff0c\u4e3a\u4ec0\u4e48\u80fd\u575a\u6301\u4e0b\u6765\u7684\u4eba\u90a3\u4e48\u5c11\uff1f ",
"answer_count": 80,
"bound_topic_ids": [
395,
4553,
23071,
91252
],
"comment_count": 4,
"is_following": false,
"follower_count": 864,
"type": "question",
"id": 267534527
},
"action_text": "\u5173\u6ce8\u4e86\u95ee\u9898",
"actor": {
"is_followed": false,
"type": "people",
"name": "\u9ad8\u96be\u9971",
"headline": "\u91d1\u878d\u4ece\u4e1a\u8005\uff0c\u516c\u4f17\u53f7\uff1a\u9ad8\u96be\u9971",
"url_token": "gao-nan-bao",
"user_type": "people",
"vip_info": {
"is_vip": true,
"vip_icon": {
"url": "https://pic3.zhimg.com/50/v2-4812630bc27d642f7cafcd6cdeca3d7a_r.png",
"night_mode_url": "https://pic3.zhimg.com/50/v2-c9686ff064ea3579730756ac6c289978_r.png"
}
},
"url": "https://api.zhihu.com/people/f75519c320c28eb190fe35dede8fe37e",
"avatar_url": "https://pic2.zhimg.com/50/v2-6bb2bb11b7fb1c4883f36731f42f7537_s.jpg",
"is_following": false,
"is_org": false,
"gender": 1,
"badge": [],
"id": "f75519c320c28eb190fe35dede8fe37e"
},
"verb": "QUESTION_FOLLOW",
"created_time": 1594700136,
"type": "feed",
"id": 1594700136964
},
{
"target": {
"author": {
"is_followed": false,
"type": "people",
"name": "\u51ac\u6696\u590f\u51c9",
"headline": "\u77e5\u4e4e\u77e5\u4e4e\u6562\u95ee\u77e5\u4e4e\u77e5\u4e4e\uff1f",
"url_token": "dong-nuan-xia-liang-23-2",
"user_type": "people",
"vip_info": {},
"url": "https://api.zhihu.com/people/6f5916d4e3504cede76bbf18a36f5072",
"avatar_url": "https://pic3.zhimg.com/50/v2-7d6ec5e88bf6f210f77a665ac3244d87_s.jpg",
"is_following": false,
"is_org": false,
"gender": 0,
"badge": [],
"id": "6f5916d4e3504cede76bbf18a36f5072"
},
"relationship": {
"is_author": false,
"is_following": false
},
"created": 1594108266,
"url": "https://api.zhihu.com/questions/405508157",
"title": "\u4e3a\u4ec0\u4e48\u73ed\u4e0a\u7684\u5c0f\u6df7\u6df7\u5f53\u4e0a\u4e86\u8001\u677f\uff0c\u800c\u6210\u7ee9\u597d\u7684\u8fd8\u5728\u4e3a\u9996\u4ed8\u53d1\u6101\uff1f",
"excerpt": "",
"detail": "",
"answer_count": 225,
"bound_topic_ids": [
988,
3145,
4478,
5582
],
"comment_count": 27,
"is_following": false,
"follower_count": 612,
"type": "question",
"id": 405508157
},
"action_text": "\u5173\u6ce8\u4e86\u95ee\u9898",
"actor": {
"is_followed": false,
"type": "people",
"name": "\u9ad8\u96be\u9971",
"headline": "\u91d1\u878d\u4ece\u4e1a\u8005\uff0c\u516c\u4f17\u53f7\uff1a\u9ad8\u96be\u9971",
"url_token": "gao-nan-bao",
"user_type": "people",
"vip_info": {
"is_vip": true,
"vip_icon": {
"url": "https://pic3.zhimg.com/50/v2-4812630bc27d642f7cafcd6cdeca3d7a_r.png",
"night_mode_url": "https://pic3.zhimg.com/50/v2-c9686ff064ea3579730756ac6c289978_r.png"
}
},
"url": "https://api.zhihu.com/people/f75519c320c28eb190fe35dede8fe37e",
"avatar_url": "https://pic2.zhimg.com/50/v2-6bb2bb11b7fb1c4883f36731f42f7537_s.jpg",
"is_following": false,
"is_org": false,
"gender": 1,
"badge": [],
"id": "f75519c320c28eb190fe35dede8fe37e"
},
"verb": "QUESTION_FOLLOW",
"created_time": 1594700084,
"type": "feed",
"id": 1594700084922
},
...
]
}
```
user_zvideos.json 👉 你发布的视频信息
```json
{
"data": [
{
"id": "1243977249122508800",
"title": "14��ӡ���к�Ԥ�ԣ�2020���飡2021������ܸ����أ�",
"image_url": "https://pic2.zhimg.com/v2-69974dfb2c113b90e14bea96be96a93f_r.jpg?source=12a79843",
"description": "",
"excerpt": "",
"author": {
"is_followed": false,
"avatar_url_template": "https://pic4.zhimg.com/v2-6bb2bb11b7fb1c4883f36731f42f7537.jpg?source=12a79843",
"uid": "1047782825939542016",
"user_type": "people",
"is_following": false,
"url_token": "gao-nan-bao",
"id": "f75519c320c28eb190fe35dede8fe37e",
"description": "�Ź��ںţ����ѱ�",
"name": "���ѱ�",
"is_advertiser": false,
"headline": "���ڴ�ҵ�ߣ����ںţ����ѱ�",
"gender": 1,
"url": "https://www.zhihu.com/api/v4/people/f75519c320c28eb190fe35dede8fe37e",
"avatar_url": "https://pic1.zhimg.com/v2-6bb2bb11b7fb1c4883f36731f42f7537_l.jpg?source=12a79843",
"is_org": false,
"type": "people",
"badge": [
{
"type": "identity",
"topics": null,
"description": "������ѧ ����ѧ˶ʿ"
}
],
"badge_v2": {
"title": "������ѧ ����ѧ˶ʿ",
"merged_badges": [
{
"type": "identity",
"detail_type": "identity",
"title": "��֤",
"description": "������ѧ ����ѧ˶ʿ",
"url": "https://www.zhihu.com/account/verification/intro",
"sources": [],
"icon": ""
}
],
"detail_badges": [
{
"type": "identity",
"detail_type": "identity_people",
"title": "����֤�ĸ���",
"description": "������ѧ ����ѧ˶ʿ",
"url": "https://www.zhihu.com/account/verification/intro",
"sources": [],
"icon": "https://pic4.zhimg.com/v2-4c25640069cba2a8522b15a40af2fcb0_l.png"
}
],
"icon": "https://pic3.zhimg.com/v2-4c25640069cba2a8522b15a40af2fcb0_l.png"
}
},
"updated_at": 1589368573,
"video": {
"video_id": "1243977238141333504",
"width": 1280,
"height": 720,
"duration": 380.28,
"type": "video",
"thumbnail": "https://pic1.zhimg.com/v2-69974dfb2c113b90e14bea96be96a93f_r.jpg?source=12a79843",
"is_open_bullet": false,
"playlist": {
"hd": {
"play_url": "https://vdn1.vzuu.com/HD/283c63b8-9508-11ea-a3b4-2e98f86a5892.mp4?disable_local_cache=1\u0026bu=zvideo\u0026expiration=1594713601\u0026auth_key=1594713601-0-0-4ce28a6f5e76e6fac9fd0541defd4a29\u0026f=mp4\u0026v=hw",
"bitrate": 289.351,
"duration": 380.28,
"format": "mp4",
"fps": 25,
"size": 13754321,
"height": 720,
"width": 1280,
"channels": 2,
"sample_rate": 44100,
"url": "https://vdn1.vzuu.com/HD/283c63b8-9508-11ea-a3b4-2e98f86a5892.mp4?disable_local_cache=1\u0026bu=zvideo\u0026expiration=1594713601\u0026auth_key=1594713601-0-0-4ce28a6f5e76e6fac9fd0541defd4a29\u0026f=mp4\u0026v=hw"
},
"ld": {
"play_url": "https://vdn1.vzuu.com/SD/283c63b8-9508-11ea-a3b4-2e98f86a5892.mp4?disable_local_cache=1\u0026bu=zvideo\u0026expiration=1594713601\u0026auth_key=1594713601-0-0-384f3632819f49ba777793653691adfd\u0026f=mp4\u0026v=hw",
"bitrate": 210.548,
"duration": 380.28,
"format": "mp4",
"fps": 25,
"size": 10008445,
"height": 478,
"width": 848,
"channels": 2,
"sample_rate": 44100,
"url": "https://vdn1.vzuu.com/SD/283c63b8-9508-11ea-a3b4-2e98f86a5892.mp4?disable_local_cache=1\u0026bu=zvideo\u0026expiration=1594713601\u0026auth_key=1594713601-0-0-384f3632819f49ba777793653691adfd\u0026f=mp4\u0026v=hw"
},
"sd": {
"play_url": "https://vdn1.vzuu.com/SD/283c63b8-9508-11ea-a3b4-2e98f86a5892.mp4?disable_local_cache=1\u0026bu=zvideo\u0026expiration=1594713601\u0026auth_key=1594713601-0-0-384f3632819f49ba777793653691adfd\u0026f=mp4\u0026v=hw",
"bitrate": 210.548,
"duration": 380.28,
"format": "mp4",
"fps": 25,
"size": 10008445,
"height": 478,
"width": 848,
"channels": 2,
"sample_rate": 44100,
"url": "https://vdn1.vzuu.com/SD/283c63b8-9508-11ea-a3b4-2e98f86a5892.mp4?disable_local_cache=1\u0026bu=zvideo\u0026expiration=1594713601\u0026auth_key=1594713601-0-0-384f3632819f49ba777793653691adfd\u0026f=mp4\u0026v=hw"
}
},
"playlist_v2": {
"hd": {
"play_url": "https://vdn1.vzuu.com/HD/v2_283c63b8-9508-11ea-a3b4-2e98f86a5892.mp4?disable_local_cache=1\u0026bu=zvideo\u0026expiration=1594713601\u0026auth_key=1594713601-0-0-60b9b7feb693f4ae3b1f12e3740de13b\u0026f=v2mp4\u0026v=hw",
"bitrate": 260.08,
"duration": 380.25,
"format": "mp4",
"fps": 25,
"size": 12361932,
"height": 720,
"width": 1280,
"channels": 2,
"sample_rate": 44100,
"url": "https://vdn1.vzuu.com/HD/v2_283c63b8-9508-11ea-a3b4-2e98f86a5892.mp4?disable_local_cache=1\u0026bu=zvideo\u0026expiration=1594713601\u0026auth_key=1594713601-0-0-60b9b7feb693f4ae3b1f12e3740de13b\u0026f=v2mp4\u0026v=hw"
}
},
"status": "success",
"is_paid": false,
"is_trial": false
},
"published_at": 1589368573,
"play_count": 20163,
"comment_count": 66,
"voteup_count": 35,
"voting": 0,
"is_reviewing": false,
"is_update_reviewing": false,
"url": "https://www.zhihu.com/api/v4/zvideos/1243977249122508800",
"type": "zvideo",
"comment_permission": "all",
"can_comment": {
"status": true,
"reason": ""
},
"admin_closed_comment": false,
"attached_info": "wgE6CAQQYxoTMTI0Mzk3NzI0OTEyMjUwODgwMCD9re/1BSgjMEI4AEITMTI0Mzk3NzIzODE0MTMzMzUwNA==",
"is_visible": true,
"is_labeled": false,
"is_favorited": false
},
...
]
}
```
****
## 哔哩哔哩
!> **说明**:需登录账号 (建议扫码登录).
### 使用步骤
1. 点击**哔哩哔哩**数据源按钮

2. 在弹出的浏览器中登录哔哩哔哩(建议扫码登录)

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
user_info.json 👉 你的哔哩哔哩个人信息
```json
{
"code": 0,
"message": "0",
"ttl": 1,
"data":
{
"mid": 43922500,
"uname": "小小r",
"userid": "bili_803233053",
"sign": "在读研究********算机/分享见闻 ...",
"birthday": "19*****0",
"sex": "男",
"nick_free": false,
"rank": "正式会员"
}
}
```
bilibili_history.json 👉 你的哔哩哔哩观看历史信息
```json
[
{
"code": 0,
"message": "0",
"ttl": 1,
"data": [
{
"aid": 11497399,
"videos": 1,
"tid": 182,
"tname": "影视杂谈",
"copyright": 1,
"pic": "http://i0.hdslb.com/bfs/archive/6075ff852339c6159254995006d1ade45e6b3633.jpg",
"title": "【看电影了没】美军与索马里海盗的首次交手,真实改编《菲利普船长》",
"pubdate": 1498014930,
"ctime": 1498014929,
"desc": "这是一个索马里海盗绑架美帝船长勒索一千万美金的故事。\n菲利普船长 Captain Phillips (2013)",
"state": 0,
"attribute": 49152,
"duration": 716,
"rights": {
"bp": 0,
"elec": 0,
"download": 0,
"movie": 0,
"pay": 0,
"hd5": 0,
"no_reprint": 0,
"autoplay": 1,
"ugc_pay": 0,
"is_cooperation": 0,
"ugc_pay_preview": 0,
"no_background": 0
},
"owner": {
"mid": 82366241,
"name": "看电影了没",
"face": "http://i2.hdslb.com/bfs/face/2e65498cc57597fba6699fcf934a02813b68cfd2.jpg"
},
"stat": {
"aid": 11497399,
"view": 39897,
"danmaku": 234,
"reply": 119,
"favorite": 185,
"coin": 218,
"share": 46,
"now_rank": 0,
"his_rank": 0,
"like": 156,
"dislike": 0
},
"dynamic": "",
"cid": 19008391,
"dimension": {
"width": 0,
"height": 0,
"rotate": 0
},
"favorite": false,
"type": 3,
"sub_type": 0,
"device": 2,
"page": {
"cid": 19008391,
"page": 1,
"from": "vupload",
"part": "P1",
"duration": 716,
"vid": "",
"weblink": "",
"dimension": {
"width": 0,
"height": 0,
"rotate": 0
}
},
"count": 1,
"progress": -1,
"view_at": 1594551867,
"kid": 11497399,
"business": "archive",
"redirect_link": "https://www.bilibili.com/video/av11497399",
"bvid": "BV1ix411h7YF"
},
...
]
}
]
```
***
## 网易云音乐
!> **说明**:需登录, 参照使用步骤说明.
### 使用步骤
1. 点击**网易云音乐**数据源按钮

2. 登录网易云音乐

!> 支持两种登录方式: 1.手机号码+密码 2.邮箱+密码
3. 选择数据保存路径

2. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
user_detail.json 👉 你的网易云音乐个人基本信息
```json
{
"level": 8,
"listenSongs": 7273,
"userPoint": {
"userId": 86327702,
"balance": 310,
"updateTime": 1594711724012,
"version": 10,
"status": 0,
"blockBalance": 0
},
"mobileSign": false,
"pcSign": false,
"profile": {
"avatarImgIdStr": "109951163309389360",
"backgroundImgIdStr": "2002210674180203",
"description": "",
"userId": 86327702,
"vipType": 11,
"userType": 0,
"createTime": 1439711844633,
"nickname": "kangvcar",
"avatarUrl": "http://p1.music.126.net/mJQUHjaq2bzqxkgTOCjZEw==/109951163309389360.jpg",
"mutual": false,
"followed": false,
"remarkName": null,
"authStatus": 0,
"detailDescription": "",
"experts": {},
"expertTags": null,
"djStatus": 0,
"accountStatus": 0,
"birthday": 752774400000,
"gender": 1,
"province": 440000,
"city": 440800,
"defaultAvatar": false,
"avatarImgId": 109951163309389360,
"backgroundImgId": 2002210674180203,
"backgroundUrl": "http://p1.music.126.net/bmA_ablsXpq3Tk9HlEg9sA==/2002210674180203.jpg",
"signature": "",
"authority": 0,
"followeds": 4,
"follows": 18,
"blacklist": false,
"eventCount": 7,
"allSubscribedCount": 0,
"playlistBeSubscribedCount": 0,
"avatarImgId_str": "109951163309389360",
"followTime": null,
"followMe": false,
"artistIdentity": [],
"cCount": 0,
"sDJPCount": 0,
"playlistCount": 2,
"sCount": 0,
"newFollows": 18
},
"peopleCanSeeMyPlayRecord": true,
"bindings": [
{
"url": "",
"userId": 86327702,
"expiresIn": 2147483647,
"refreshTime": 1501127865,
"bindingTime": 1501127865204,
"tokenJsonStr": null,
"expired": false,
"id": 3184808038,
"type": 1
},
{
"url": "",
"userId": 86327702,
"expiresIn": 7776000,
"refreshTime": 1496200328,
"bindingTime": 1496200328687,
"tokenJsonStr": null,
"expired": true,
"id": 3129778571,
"type": 5
},
{
"url": "",
"userId": 86327702,
"expiresIn": 7200,
"refreshTime": 1594557913,
"bindingTime": 1496200309924,
"tokenJsonStr": null,
"expired": true,
"id": 3129773699,
"type": 10
},
{
"url": "",
"userId": 86327702,
"expiresIn": 2147483647,
"refreshTime": 0,
"bindingTime": 0,
"tokenJsonStr": null,
"expired": false,
"id": 40242417,
"type": 0
}
],
"adValid": false,
"code": 200,
"createTime": 1439711844633,
"createDays": 1794
}
```
user_record_all.json 👉 你的网易云音乐听歌总榜信息
```json
{
"allData": [
{
"playCount": 0,
"score": 100,
"song": {
"name": "让他走",
"id": 444745115,
"pst": 0,
"t": 0,
"ar": [
{
"id": 12200907,
"name": "BAMBOO",
"tns": [],
"alias": []
}
],
"alia": [],
"pop": 100,
"st": 0,
"rt": null,
"fee": 0,
"v": 6,
"crbt": null,
"cf": "",
"al": {
"id": 35019857,
"name": "让他走",
"picUrl": "http://p1.music.126.net/C0ByjZtVJuFJlVTpub7shw==/109951162817503226.jpg",
"tns": [],
"pic_str": "109951162817503226",
"pic": 109951162817503230
},
"dt": 246047,
"h": {
"br": 320000,
"fid": 0,
"size": 9852387,
"vd": -38200
},
"m": {
"br": 192000,
"fid": 0,
"size": 5911449,
"vd": -35800
},
"l": {
"br": 128000,
"fid": 0,
"size": 3940981,
"vd": -34000
},
"a": null,
"cd": "1",
"no": 1,
"rtUrl": null,
"ftype": 0,
"rtUrls": [],
"djId": 0,
"copyright": 0,
"s_id": 0,
"mark": 0,
"originCoverType": 0,
"noCopyrightRcmd": null,
"rtype": 0,
"rurl": null,
"mst": 9,
"cp": 0,
"mv": 0,
"publishTime": 1451577600000,
"privilege": {
"id": 444745115,
"fee": 0,
"payed": 0,
"st": 0,
"pl": 320000,
"dl": 320000,
"sp": 7,
"cp": 1,
"subp": 1,
"cs": false,
"maxbr": 320000,
"fl": 320000,
"toast": false,
"flag": 128,
"preSell": false
}
}
},
{
"playCount": 0,
"score": 60,
"song": {
"name": "Deephug",
"id": 1350675133,
"pst": 0,
"t": 0,
"ar": [
{
"id": 31345603,
"name": "Ali_sir",
"tns": [],
"alias": []
}
],
"alia": [],
"pop": 25,
"st": 0,
"rt": "",
"fee": 0,
"v": 14,
"crbt": null,
"cf": "",
"al": {
"id": 75792708,
"name": "Deephug",
"picUrl": "http://p1.music.126.net/eL8LQxwwWuP1qB4RA44v6Q==/109951163910611726.jpg",
"tns": [],
"pic_str": "109951163910611726",
"pic": 109951163910611730
},
"dt": 187167,
"h": {
"br": 320000,
"fid": 0,
"size": 7488827,
"vd": 0
},
"m": {
"br": 192000,
"fid": 0,
"size": 4493314,
"vd": 0
},
"l": {
"br": 128000,
"fid": 0,
"size": 2995557,
"vd": 0
},
"a": null,
"cd": "01",
"no": 1,
"rtUrl": null,
"ftype": 0,
"rtUrls": [],
"djId": 0,
"copyright": 0,
"s_id": 0,
"mark": 64,
"originCoverType": 0,
"noCopyrightRcmd": {
"type": 2,
"typeDesc": "其它版本可播",
"songId": null
},
"rtype": 0,
"rurl": null,
"mst": 9,
"cp": 0,
"mv": 0,
"publishTime": 0,
"privilege": {
"id": 1350675133,
"fee": 0,
"payed": 0,
"st": -200,
"pl": 0,
"dl": 0,
"sp": 0,
"cp": 0,
"subp": 0,
"cs": false,
"maxbr": 320000,
"fl": 0,
"toast": false,
"flag": 66,
"preSell": false
}
}
},
...
],
"code": 200
}
```
user_record_week.json 👉 你的网易云音乐听歌周榜信息
```json
{
"weekData": [
{
"playCount": 0,
"score": 100,
"song": {
"name": "爱的可能",
"id": 545350518,
"pst": 0,
"t": 0,
"ar": [
{
"id": 9292,
"name": "孙露",
"tns": [],
"alias": []
}
],
"alia": [],
"pop": 100,
"st": 0,
"rt": null,
"fee": 8,
"v": 110,
"crbt": null,
"cf": "",
"al": {
"id": 37873648,
"name": "超越",
"picUrl": "http://p1.music.126.net/Gu4XNxlRPlVCVacQPTLQag==/109951163190065579.jpg",
"tns": [],
"pic_str": "109951163190065579",
"pic": 109951163190065580
},
"dt": 287285,
"h": {
"br": 320000,
"fid": 0,
"size": 11493921,
"vd": -21000
},
"m": {
"br": 192000,
"fid": 0,
"size": 6896370,
"vd": -18400
},
"l": {
"br": 128000,
"fid": 0,
"size": 4597595,
"vd": -16800
},
"a": null,
"cd": "1",
"no": 13,
"rtUrl": null,
"ftype": 0,
"rtUrls": [],
"djId": 0,
"copyright": 2,
"s_id": 0,
"mark": 65536,
"originCoverType": 0,
"noCopyrightRcmd": null,
"mst": 9,
"cp": 1416266,
"mv": 0,
"rtype": 0,
"rurl": null,
"publishTime": 1520956800000,
"privilege": {
"id": 545350518,
"fee": 8,
"payed": 0,
"st": 0,
"pl": 128000,
"dl": 0,
"sp": 7,
"cp": 1,
"subp": 1,
"cs": false,
"maxbr": 999000,
"fl": 128000,
"toast": false,
"flag": 0,
"preSell": false
}
}
},
{
"playCount": 0,
"score": 66,
"song": {
"name": "月亮惹的祸",
"id": 5243631,
"pst": 0,
"t": 0,
"ar": [
{
"id": 6469,
"name": "张宇",
"tns": [],
"alias": []
}
],
"alia": [],
"pop": 100,
"st": 0,
"rt": "600902000005653853",
"fee": 8,
"v": 886,
"crbt": "b22bf03548f1da6b0416cc813fe218de",
"cf": "",
"al": {
"id": 511419,
"name": "大人的情歌",
"picUrl": "http://p1.music.126.net/cV5aZJ4et-Nm-5Mj74afoQ==/107752139539289.jpg",
"tns": [],
"pic": 107752139539289
},
"dt": 260773,
"h": {
"br": 320000,
"fid": 0,
"size": 10433350,
"vd": -2
},
"m": {
"br": 192000,
"fid": 0,
"size": 6260027,
"vd": -1
},
"l": {
"br": 128000,
"fid": 0,
"size": 4173366,
"vd": -1
},
"a": null,
"cd": "1",
"no": 9,
"rtUrl": null,
"ftype": 0,
"rtUrls": [],
"djId": 0,
"copyright": 1,
"s_id": 0,
"mark": 0,
"originCoverType": 0,
"noCopyrightRcmd": null,
"mst": 9,
"cp": 13009,
"mv": 0,
"rtype": 0,
"rurl": null,
"publishTime": 1256832000000,
"privilege": {
"id": 5243631,
"fee": 0,
"payed": 0,
"st": -100,
"pl": 0,
"dl": 0,
"sp": 7,
"cp": 1,
"subp": 1,
"cs": false,
"maxbr": 999000,
"fl": 0,
"toast": false,
"flag": 256,
"preSell": false
}
}
},
]
}
```
user_playlist.json 👉 你的网易云音乐收藏歌单信息
```json
{
"more": true,
"playlist": [
{
"subscribers": [],
"subscribed": false,
"creator": {
"defaultAvatar": false,
"province": 440000,
"authStatus": 0,
"followed": false,
"avatarUrl": "http://p1.music.126.net/mJQUHjaq2bzqxkgTOCjZEw==/109951163309389360.jpg",
"accountStatus": 0,
"gender": 1,
"city": 440800,
"birthday": 752774400000,
"userId": 86327702,
"userType": 0,
"nickname": "kangvcar",
"signature": "",
"description": "",
"detailDescription": "",
"avatarImgId": 109951163309389360,
"backgroundImgId": 2002210674180203,
"backgroundUrl": "http://p1.music.126.net/bmA_ablsXpq3Tk9HlEg9sA==/2002210674180203.jpg",
"authority": 0,
"mutual": false,
"expertTags": null,
"experts": null,
"djStatus": 0,
"vipType": 11,
"remarkName": null,
"avatarImgIdStr": "109951163309389360",
"backgroundImgIdStr": "2002210674180203",
"avatarImgId_str": "109951163309389360"
},
"artists": null,
"tracks": null,
"updateFrequency": null,
"backgroundCoverId": 0,
"backgroundCoverUrl": null,
"titleImage": 0,
"titleImageUrl": null,
"englishTitle": null,
"opRecommend": false,
"recommendInfo": null,
"adType": 0,
"trackNumberUpdateTime": 1594208383098,
"subscribedCount": 0,
"userId": 86327702,
"createTime": 1439711745054,
"highQuality": false,
"coverImgId": 109951165083336660,
"newImported": false,
"anonimous": false,
"updateTime": 1594208383098,
"specialType": 5,
"commentThreadId": "A_PL_0_98489963",
"coverImgUrl": "https://p2.music.126.net/opNi98yiEA9HCfyNDgeD9w==/109951165083336659.jpg",
"totalDuration": 0,
"privacy": 0,
"trackUpdateTime": 1594602030922,
"trackCount": 483,
"playCount": 3929,
"cloudTrackCount": 0,
"ordered": true,
"tags": [],
"description": null,
"status": 0,
"name": "kangvcar喜欢的音乐",
"id": 98489963,
"coverImgId_str": "109951165083336659"
},
{
"subscribers": [],
"subscribed": false,
"creator": {
"defaultAvatar": false,
"province": 440000,
"authStatus": 0,
"followed": false,
"avatarUrl": "http://p1.music.126.net/mJQUHjaq2bzqxkgTOCjZEw==/109951163309389360.jpg",
"accountStatus": 0,
"gender": 1,
"city": 440800,
"birthday": 752774400000,
"userId": 86327702,
"userType": 0,
"nickname": "kangvcar",
"signature": "",
"description": "",
"detailDescription": "",
"avatarImgId": 109951163309389360,
"backgroundImgId": 2002210674180203,
"backgroundUrl": "http://p1.music.126.net/bmA_ablsXpq3Tk9HlEg9sA==/2002210674180203.jpg",
"authority": 0,
"mutual": false,
"expertTags": null,
"experts": null,
"djStatus": 0,
"vipType": 11,
"remarkName": null,
"avatarImgIdStr": "109951163309389360",
"backgroundImgIdStr": "2002210674180203",
"avatarImgId_str": "109951163309389360"
},
"artists": null,
"tracks": null,
"updateFrequency": null,
"backgroundCoverId": 0,
"backgroundCoverUrl": null,
"titleImage": 0,
"titleImageUrl": null,
"englishTitle": null,
"opRecommend": false,
"recommendInfo": null,
"adType": 0,
"trackNumberUpdateTime": 1577702118015,
"subscribedCount": 0,
"userId": 86327702,
"createTime": 1577702117981,
"highQuality": false,
"coverImgId": 109951163910611730,
"newImported": false,
"anonimous": false,
"updateTime": 1577702118015,
"specialType": 20,
"commentThreadId": "A_PL_0_3159395847",
"coverImgUrl": "https://p2.music.126.net/eL8LQxwwWuP1qB4RA44v6Q==/109951163910611726.jpg",
"totalDuration": 0,
"privacy": 0,
"trackUpdateTime": 1594536447389,
"trackCount": 10,
"playCount": 0,
"cloudTrackCount": 0,
"ordered": false,
"tags": [],
"description": null,
"status": 0,
"name": "kangvcar的2019年度歌单",
"id": 3159395847,
"coverImgId_str": "109951163910611726"
}
...
],
"code": 200
}
```
user_follows.json 👉 你的网易云音乐粉丝信息
```json
{
"follow": [
{
"py": "hczzz",
"time": 0,
"userId": 500932525,
"vipType": 0,
"remarkName": null,
"follows": 2,
"followeds": 3,
"avatarUrl": "http://p1.music.126.net/VnZiScyynLG7atLIZ2YPkw==/18686200114669622.jpg",
"authStatus": 0,
"userType": 0,
"gender": 0,
"expertTags": null,
"experts": null,
"mutual": false,
"accountStatus": 0,
"nickname": "浩城zzz",
"followed": false,
"signature": null,
"vipRights": null,
"eventCount": 0,
"playlistCount": 1
},
{
"py": "mlys",
"time": 0,
"userId": 1328375954,
"vipType": 0,
"remarkName": null,
"follows": 21,
"followeds": 30,
"avatarUrl": "http://p1.music.126.net/uTG9jnbm07rkCytQkYiM2Q==/109951163752920877.jpg",
"authStatus": 0,
"userType": 0,
"gender": 2,
"expertTags": null,
"experts": null,
"mutual": false,
"accountStatus": 0,
"nickname": "陌路勇士",
"followed": false,
"signature": null,
"vipRights": null,
"eventCount": 0,
"playlistCount": 4
},
...
],
"touchCount": 0,
"more": false,
"code": 200
}
```
user_followeds.json 👉 你的网易云音乐关注的人
```json
{
"code": 200,
"more": false,
"followeds": [
{
"py": "xllcv",
"time": 1562118776988,
"avatarUrl": "http://p1.music.126.net/XKRTrv-W-u5p3jOAOYzJFQ==/109951164189828402.jpg",
"authStatus": 0,
"userType": 0,
"gender": 2,
"expertTags": null,
"experts": null,
"nickname": "小萝莉cv",
"follows": 1928,
"remarkName": null,
"followeds": 112,
"accountStatus": 0,
"mutual": false,
"vipType": 0,
"userId": 1900157189,
"followed": false,
"signature": "",
"eventCount": 0,
"playlistCount": 1
},
{
"py": "wzs806",
"time": 1537697737859,
"avatarUrl": "http://p1.music.126.net/-Md9USYFHR-zHviSOtWbQw==/18526770929966003.jpg",
"authStatus": 0,
"userType": 0,
"gender": 1,
"expertTags": null,
"experts": null,
"nickname": "吴志盛806",
"follows": 6,
"remarkName": null,
"followeds": 1,
"accountStatus": 0,
"mutual": false,
"vipType": 0,
"userId": 500977806,
"followed": false,
"signature": null,
"eventCount": 0,
"playlistCount": 8
},
...
]
}
```
user_event.json 👉 你的网易云音乐动态信息
```json
{
"lasttime": 1540053110687,
"more": false,
"size": 7,
"events": [
{
"actName": null,
"pendantData": null,
"forwardCount": 0,
"lotteryEventData": null,
"tailMark": null,
"json": "{\"msg\":\"\",\"playlist\":{\"name\":\"kangvcar喜欢的音乐\",\"id\":98489963,\"trackNumberUpdateTime\":1574679868924,\"status\":0,\"userId\":86327702,\"createTime\":1439711745054,\"updateTime\":1574779380255,\"subscribedCount\":0,\"trackCount\":446,\"cloudTrackCount\":0,\"coverImgUrl\":\"http://p2.music.126.net/D7C8Lf0obahn131m74gQsQ==/19187577416921199.jpg\",\"coverImgId\":19187577416921199,\"description\":null,\"tags\":[],\"playCount\":3560,\"trackUpdateTime\":1574864716901,\"specialType\":5,\"totalDuration\":0,\"creator\":{\"defaultAvatar\":false,\"province\":440000,\"authStatus\":0,\"followed\":false,\"avatarUrl\":\"http://p1.music.126.net/mJQUHjaq2bzqxkgTOCjZEw==/109951163309389360.jpg\",\"accountStatus\":0,\"gender\":1,\"city\":440800,\"birthday\":752774400000,\"userId\":86327702,\"userType\":0,\"nickname\":\"kangvcar\",\"signature\":\"\",\"description\":\"\",\"detailDescription\":\"\",\"avatarImgId\":109951163309389360,\"backgroundImgId\":2002210674180203,\"backgroundUrl\":\"http://p1.music.126.net/bmA_ablsXpq3Tk9HlEg9sA==/2002210674180203.jpg\",\"authority\":0,\"mutual\":false,\"expertTags\":null,\"experts\":null,\"djStatus\":0,\"vipType\":0,\"remarkName\":null,\"avatarImgIdStr\":\"109951163309389360\",\"backgroundImgIdStr\":\"2002210674180203\",\"avatarImgId_str\":\"109951163309389360\"},\"tracks\":null,\"subscribers\":[],\"subscribed\":null,\"commentThreadId\":\"A_PL_0_98489963\",\"newImported\":false,\"adType\":0,\"highQuality\":false,\"privacy\":0,\"ordered\":true,\"anonimous\":false,\"coverImgId_str\":\"19187577416921199\"}}",
"user": {
"defaultAvatar": false,
"province": 440000,
"authStatus": 0,
"followed": false,
"avatarUrl": "http://p1.music.126.net/mJQUHjaq2bzqxkgTOCjZEw==/109951163309389360.jpg",
"accountStatus": 0,
"gender": 1,
"city": 440800,
"birthday": 752774400000,
"userId": 86327702,
"userType": 0,
"nickname": "kangvcar",
"signature": "",
"description": "",
"detailDescription": "",
"avatarImgId": 109951163309389360,
"backgroundImgId": 2002210674180203,
"backgroundUrl": "http://p1.music.126.net/bmA_ablsXpq3Tk9HlEg9sA==/2002210674180203.jpg",
"authority": 0,
"mutual": false,
"expertTags": null,
"experts": null,
"djStatus": 0,
"vipType": 11,
"remarkName": null,
"avatarImgIdStr": "109951163309389360",
"backgroundImgIdStr": "2002210674180203",
"urlAnalyze": false,
"vipRights": {
"associator": {
"vipCode": 100,
"rights": true
},
"musicPackage": null,
"redVipAnnualCount": 1
},
"avatarImgId_str": "109951163309389360",
"followeds": 4
},
"uuid": "publish-157500309506494735",
"eventTime": 1575003095233,
"extJsonInfo": {
"actId": 0,
"actIds": [],
"uuid": "publish-157500309506494735",
"extType": "",
"extId": "",
"circleId": null,
"circlePubType": null,
"extParams": {}
},
"tmplId": 0,
"expireTime": 0,
"rcmdInfo": null,
"pics": [],
"actId": 0,
"showTime": 1575003095233,
"id": 7912732454,
"type": 13,
"topEvent": false,
"insiteForwardCount": 0,
"info": {
"commentThread": {
"id": "A_EV_2_7912732454_86327702",
"resourceInfo": null,
"resourceType": 2,
"commentCount": 0,
"likedCount": 0,
"shareCount": 0,
"hotCount": 0,
"latestLikedUsers": null,
"resourceTitle": null,
"resourceId": 0,
"resourceOwnerId": 0
},
"latestLikedUsers": null,
"liked": false,
"comments": null,
"resourceType": 2,
"resourceId": 7912732454,
"likedCount": 0,
"commentCount": 0,
"shareCount": 0,
"threadId": "A_EV_2_7912732454_86327702"
}
},
...
],
"code": 200
}
```
***
## QQ好友
!> **说明**:需登录, 参照使用步骤说明.
### 使用步骤
1. 点击**QQ好友**数据源按钮

2. 仔细查看操作步骤说明

3. 在弹出的浏览器中登录

4. 登录成功后, 点击“QQ充值”, 再点击“更换”按钮即可(无需选择)

5. 切换到该窗口,选择“已登录并打开充值界面且点开列表(不用选择表项),保存为json” 按钮,即可开始爬取信息

6. 选择数据保存路径

?> 👍 每个数据源的爬取可能会生成多个文件, 所以建议为每个数据源新建一个文件夹来保存数据.
7. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
friend_list.json 👉 你的QQ好友信息
```json
[
{
"raw": " 自己(123123123) ",
"group": " 我的好友 ",
"view_name": " 自己",
"qqnumber": "123123123"
},
{
"raw": "CAD郭东(351823450)",
"group": " 我的好友 ",
"view_name": "CAD郭东",
"qqnumber": "351823450"
},
{
"raw": "babyQ(66600000)",
"group": " 我的好友 ",
"view_name": "babyQ",
"qqnumber": "66600000"
},
...
]
```
***
## QQ群
!> **说明**:需登录, 参照使用步骤说明.
### 使用步骤
1. 点击**QQ群**数据源按钮

2. 仔细查看操作步骤说明

3. 选择数据保存路径

?> 👍 每个群的信息保存为一个json文件, 所以建议新建一个文件夹来保存数据.
4. 在弹出的浏览器中登录

5. 登录成功后,无需在浏览器做任何操作

6. 切换到该窗口,选择“已登录并打开界面,保存为json” 按钮,即可开始爬取信息

7. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
Linux-RHCE(204507257).json 👉 以群名命名的json文件,包含该群所有成员信息
```json
[
{
"member": "中星班主任",
"nick_name": "我的班主任",
"qqnumber": 2853537590,
"sex": "女",
"qqage": "8年",
"join_date": "2016/12/08",
"last_post": "2017/12/01"
},
{
"member": "海平信息钟老师",
"nick_name": "钟老师",
"qqnumber": 1522709362,
"sex": "女",
"qqage": "9年",
"join_date": "2016/12/16",
"last_post": "2017/10/25"
},
{
"member": "曾罗林",
"nick_name": NaN,
"qqnumber": 2853537596,
"sex": "未知",
"qqage": "8年",
"join_date": "2017/08/15",
"last_post": "2017/08/15"
},
...
]
```
***
## 生成朋友圈相册
!> **说明**:使用该功能前需要您先获取包含您朋友圈数据的链接, 参照使用步骤说明.
### 使用步骤
1. 点击微信公众号“**出书啦**”
2. 根据公众号指引添加“**出书啦**”小编为你的好友,然后你将朋友圈开放给他看
3. 小编会自动开始采集你的朋友圈数据,采集完毕后,小编会发给你一个“**专属链接**”
4. 这个“**专属链接**”里面的内容就是你的个人朋友圈数据。
!> 你必须先获得该“**专属链接**”才能进行本程序的下一步!
5. 点击**生成朋友圈相册**数据源按钮

6. 选择数据保存路径

7. 等待浏览器自动打开,并在弹窗中输入你的“**专属链接**”, 点击确定即可自动生成相册

8. 查看爬取的数据 (PDF格式)

### 数据说明
自行查看生成的PDF文件
****
## Chrome历史记录
!> **说明**:无需登录账号, 只支持Windows系统,且默认History数据库路径为`C:\Users\\AppData\Local\Google\Chrome\User Data\Default`
### 使用步骤
1. 点击**Chrome历史记录**数据源按钮

2. 选择数据保存路径

3. 查看爬取的数据 (json格式)

### 数据说明
browser_data.json 👉 你的Chrome浏览器历史记录信息
```json
[
{
"urls.id": 994,
"urls.url": "https://www.youtube.com/?gl=HK&tab=r1",
"urls.title": "(31) YouTube",
"urls.visit_count": 38,
"urls.last_visit_time": "2020-07-14 22:21:44",
"visits.visit_time": "2020-07-09 12:20:26",
"visits.visit_duration": 0
},
{
"urls.id": 999,
"urls.url": "http://www.baidu.com/",
"urls.title": "百度一下,你就知道",
"urls.visit_count": 2,
"urls.last_visit_time": "2020-07-12 13:27:32",
"visits.visit_time": "2020-07-09 18:34:07",
"visits.visit_duration": 0
},
...
]
```
***
## 12306
!> **说明**:需登录账号.
### 使用步骤
1. 点击**12306**数据源按钮

2. 在弹出的浏览器中登录12306

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
user_info.json 👉 你的12306账号基本信息
```json
{
"validateMessagesShowId": "_validatorMessage",
"status": true,
"httpstatus": 200,
"data": {
"userTypeName": "成人",
"picFlag": "1",
"canUpload": "N",
"userPassword": "",
"notice1": "",
"canAddGAT": false,
"isMobileCheck": "Y",
"userDTO": {
"loginUserDTO": {
"center": "E",
"login_channel": "E",
"login_site": "E",
"login_id": "0atMvH8w1z0aaackKOhCL8y1BR9",
"agent_contact": "1*******",
"user_type": "1",
"user_name": "*******",
"name": "*******",
"id_type_code": "1",
"id_type_name": "中国居民身份证",
"id_no": "4**************",
"member_id": "*",
"member_level": "*",
"userIpAddress": "14.210*******",
"is_active": "Y",
"allEncStr": "25da32345**************4a17601355663f11",
"isYongThan12": "N",
"isAdult": "Y",
"isYongThan10": "N",
"isOldThan60": "N",
"isYongThan14": "N",
"isYongThan18": "N",
"isDisable": "N",
"gat_born_date": "",
"gat_valid_date_start": "",
"gat_valid_date_end": "",
"gat_version": ""
},
"studentInfoDTO": {},
"is_receive": "Y",
"password": "",
"password_new": "",
"pwd_question": "",
"pwd_answer": "",
"sex_code": "M",
"born_date": "199*******00:00",
"country_code": "CN",
"mobile_no": "1*******",
"phone_no": "",
"email": "*******.com",
"address": "",
"postalcode": "",
"is_active": "Y",
"revSm_code": "Y",
"last_login_time": "",
"user_id": 1000004*******641,
"phone_flag": "*",
"encourage_flag": "*",
"user_status": "1",
"check_id_flag": "0",
"is_valid": "Y",
"display_control_flag": "1",
"needModifyEmail": "N",
"flag_member": "N",
"pic_control_flag": "",
"regist_time": "",
"allEncStr": "c41be36f14c*******89e2812f079c",
"ivr_passwd": ""
},
"notice": "已通过"
},
"messages": [],
"validateMessages": {}
}
```
user_address.json 👉 你的12306账号车票快递地址信息
```json
{
"validateMessagesShowId": "_validatorMessage",
"status": true,
"httpstatus": 200,
"data": {
"isNeedAgree": false,
"can_operate_passenger_days_after": 30,
"isCanAddAddress": true,
"errorMsg": "操作失败",
"address_max_size": 20,
"addresses": []
},
"messages": [],
"validateMessages": {}
}
```
user_passengers.json 👉 你的12306账号联系人信息
```json
{
"validateMessagesShowId": "_validatorMessage",
"status": true,
"httpstatus": 200,
"data": {
"datas": [
{
"passenger_name": "***",
"sex_code": "M",
"sex_name": "男",
"born_date": "199***0 00:00:00",
"country_code": "CN",
"passenger_id_type_code": "1",
"passenger_id_type_name": "中国居民身份证",
"passenger_id_no": "4*****************4",
"passenger_type": "1",
"passenger_flag": "0",
"passenger_type_name": "成人",
"mobile_no": "13**********",
"phone_no": "",
"email": "******",
"address": "",
"postalcode": "",
"first_letter": "***",
"recordCount": "1",
"isUserSelf": "Y",
"total_times": "99",
"delete_time": "19****",
"allEncStr": "4590e72569be9bbcc58",
"isAdult": "Y",
"isYongThan10": "N",
"isYongThan14": "N",
"isOldThan60": "N",
"if_receive": "Y",
"is_active": "Y",
"is_buy_ticket": "N",
"last_time": "20190116",
"mobile_check_time": "",
"email_active_time": "",
"last_update_time": "",
"passenger_uuid": "bdc07135fbb079712a0f1c2",
"gat_born_date": "",
"gat_valid_date_start": "",
"gat_valid_date_end": "",
"gat_version": ""
}
],
"flag": true,
"pageTotal": 1
},
"messages": [],
"validateMessages": {}
}
```
user_order.json 👉 你的12306账号未出行订单信息
```json
{
"validateMessagesShowId": "_validatorMessage",
"status": true,
"httpstatus": 200,
"data": {
"order_total_number": "",
"show_catering_button": true,
"OrderDTODataList": [测试账号没有订单记录]
},
"messages": [],
"validateMessages": {}
}
```
user_order_no_complete.json 👉 你的12306账号未完成订单信息
```json
{
"validateMessagesShowId": "_validatorMessage",
"status": true,
"httpstatus": 200,
"messages": [],
"validateMessages": {测试账号没有订单记录}
}
```
***
## 博客园
!> **说明**:无需登录账号, 输入博客园用户名即可 (如 dingxingxing ) .
### 使用步骤
1. 点击**博客园**数据源按钮g

2. 输入博客园用户名

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
cnblog_article.json 👉 你的博客园文章信息
```json
[
{
"title": "Lua\u9a9a\u64cd\u4f5c\u2014\u2014\u4e09\u5143\u6761\u4ef6\u8fd0\u7b97\u7b26",
"sumary": "\u6458\u8981\uff1a\u672c\u6587\u5730\u5740\uff1ahttps://www.cnblogs.com/oberon-zjt0806/p/13337577.html \u672c\u6587\u53c2\u8003\u4e86\u8fd9\u7bc7\u6587\u7ae0 \u4e09\u5143\u8fd0\u7b97\u7b26 \uff08\u5982\u679c\u60a8\u5df2\u7ecf\u4e86\u89e3\u4ec0\u4e48\u662f\u4e09\u5143\u8fd0\u7b97\u7b26\uff0c\u8bf7\u5927\u80c6\u7b2c\u524d\u5f80\u4e0b\u4e00\u4e2a\u7ae0\u8282\uff09 \u6211\u77e5\u9053\u6709\u4e00\u5143\u8fd0\u7b97\u7b26\uff08\u903b\u8f91\u975e\uff0c\u4f4d\u53cd\u8f6c\uff0c\u8d1f\u53f7\uff09\uff0c\u4e8c\u5143\u8fd0\u7b97\u7b26\uff08\u52a0\u51cf\u4e58\u9664\u7b49\uff09\uff0c\u8fd9\u4e09\u5143\u8fd0\u7b97\u7b26\u662f\uff1f \u9605\u8bfb\u5168\u6587",
"postdate": "2020-07-18",
"posttime": "22:14",
"views": "44"
},
...
]
```
你的文章词云分析

你的发文数量分析

***
## CSDN博客
!> **说明**:无需登录账号, 输入CSDN博客用户名即可 (如 kangvcar ) .
### 使用步骤
1. 点击**CSDN**数据源按钮g

2. 输入CSDN博客用户名

3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
csdn_article.json 👉 你的CSDN博客文章信息
```json
[
{
"title": "GIT \u68c0\u67e5\u3001\u64a4\u9500\u4fee\u6539\u7b80\u660e\u6559\u7a0b",
"sumary": "\u8bf4\u660e\uff1a\u672c\u6559\u7a0b\u7684\u6240\u6709\u64cd\u4f5c\u90fd\u5728master\u5206\u652f\u4e0a\uff0c\u4e14\u4ec5\u7528\u4e8e\u4e2a\u4eba\u4ee3\u7801\u4ed3\u5e93\u7ba1\u7406\uff0c\u64cd\u4f5c\u7684\u5b9e\u7528\u6027\u6709\u5f85\u7814\u7a76\u30024\u4e2a\u533a5\u79cd\u72b6\u6001\u672a\u4fee\u6539\uff08Origin\uff09\u5df2\u4fee\u6539\uff08Modified\uff09\u5df2\u6682\u5b58\uff08Staged\uff09\u5df2\u63d0\u4ea4\uff08Committed\uff09\u5df2\u63a8\u9001\uff08Pushed\uff09\u68c0\u67e5\u4fee\u6539\u5df2\u4fee\u6539\uff0c\u672a\u6682\u5b58\uff08\u68c0\u67e5\u5de5\u4f5c\u533a\u4e0e\u6682\u5b58\u533a\u95f4\u7684\u5dee\u5f02\uff09g...",
"postdate": "2017-12-15",
"posttime": "09:11:37",
"views": "648"
},
...
]
```
***
## Oschina开源中国博客
!> **说明**:无需登录账号, 输入开源中国博客个人主页链接 (如 [https://my.oschina.net/kangvcar](https://my.oschina.net/kangvcar) ) .
### 使用步骤
1. 点击**开源中国博客**数据源按钮gr

2. 输入开源中国博客个人主页链接, 如 [https://my.oschina.net/kangvcar](https://my.oschina.net/kangvcar) )

!> **注意**:个人主页链接最后不含 `/` (斜杆)
3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
csdn_article.json 👉 你的开源中国博客文章信息
```json
[
{
"title": "PXE/KickStart\u65e0\u4eba\u503c\u5b88\u5b89\u88c5",
"sumary": "\u5bfc\u8a00 \u4f5c\u4e3a\u4e2d\u5c0f\u516c\u53f8\u7684\u8fd0\u7ef4\uff0c\u7ecf\u5e38\u4f1a\u9047\u5230\u4e00\u4e9b\u673a\u68b0\u5f0f\u7684\u91cd\u590d\u5de5\u4f5c\uff0c\u4f8b\u5982\uff1a\u6709\u65f6\u516c\u53f8\u540c\u65f6\u4e0a\u7ebf\u51e0\u5341\u751a\u81f3\u4e0a\u767e\u53f0\u670d\u52a1\u5668\uff0c\u800c\u4e14\u9700\u8981\u6211\u4eec\u5728\u77ed\u65f6\u95f4\u5185\u5b8c\u6210\u7cfb\u7edf\u5b89\u88c5\u3002 \u5e38\u89c4\u7684\u529e\u6cd5\u6709\u4ec0\u4e48\uff1f _\u5149\u76d8\u5b89\u88c5\u7cfb\u7edf ===> \u4e00...",
"postdate": "2018/05/07",
"posttime": "21:17",
"views": "132"
},
...
]
```
***
## 简书
!> **说明**:无需登录账��, 输入简书个人主页链接 (如 [https://www.jianshu.com/u/d9c480744afd](https://www.jianshu.com/u/d9c480744afd) ) .
### 使用步骤
1. 点击**简书**数据源按钮g

2. 输入简书个人主页链接, 如 [https://www.jianshu.com/u/d9c480744afd](https://www.jianshu.com/u/d9c480744afd )

!> **注意**:个人主页链接最后不含 `/` (斜杆)
3. 选择数据保存路径

4. 查看爬取的数据 (json格式)

### 数据说明
?> 👍 由于数据信息过长, 这里只作主要数据项说明, **点击展开查看示例**
csdn_article.json 👉 你的简书文章信息
```json
[
{
"title": "\u624b\u628a\u624b\u6559\u4f60\u75281\u884cPython\u4ee3\u7801\u5b9e\u73b0FTP\u670d\u52a1\u5668 -- Pyftpdlib",
"sumary": "\u5f53\u4f60\u60f3\u5feb\u901f\u5171\u4eab\u4e00\u4e2a\u76ee\u5f55\u7684\u65f6\u5019\uff0c\u8fd9\u662f\u7279\u522b\u6709\u7528\u7684\uff0c\u53ea\u9700\u89811\u884c\u4ee3\u7801\u5373\u53ef\u5b9e\u73b0\u3002FTP \u670d\u52a1\u5668\uff0c\u5728\u6b64\u4e4b\u524d\u6211\u90fd\u662f\u4f7f\u7528Linux\u7684vsftpd\u8f6f\u4ef6\u5305\u6765\u642d\u5efaFT...",
"postdate": "2017-12-30",
"posttime": "20:35",
"views": "3360"
},
...
]
```
***
# Contributors
[](https://github.com/kangvcar/infospider/graphs/contributors)
***
# Changelog
- 2020年7月10日
1. 更新GUI布局
2. 添加GitHub、QQ好友、QQ群数据源
- 2020年7月12日
1. 修复QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail、Outlook数据源
2. 添加生成朋友圈相册功能
- 2020年7月14日
1. 修复京东、淘宝、支付宝、12306数据源
2. 添加Chrome浏览记录功能
- 2020年7月17日
1. 修复中国移动、中国联通数据源
2. 添加知乎、哔哩哔哩、网易云音乐数据源
- 2020年7月19日
1. 添加博客园、CSDN、开源中国、简书数据源
2. 编写[使用说明文档](https://infospider.vercel.app/)
3. 录制使用视频教程
- 2020年7月30日
1. 添加博客园数据分析功能
2. 使用pyechart绘制图表并生成html文件保存在数据目录下
- 2020年8月18日
1. 修复部分bug
2. 更新README.md
- 2020年9月12日
1. 更换项目Logo
- 2020年10月20日
1. 更新所有爬虫脚本
2. 制作Python-embed版InfoSpider
3. 更新logo
***
# License
GPL-3.0
================================================
FILE: docs/_coverpage.md
================================================

# **INFO-SPIDER** **1.0**
> **一个神奇的工具箱,拿回你的个人信息。**
- 简单、易用、安全、开源
- 支持众多数据源
- 模块化
[GitHub](https://github.com/kangvcar/InfoSpider)
[视频演示](https://www.bilibili.com/video/BV14f4y1R7oF/)
[获得开发者技术支持](https://mianbaoduo.com/o/bread/aZiTlJo=)
[Get Started](#INFO-SPIDER)
================================================
FILE: docs/ads.txt
================================================
google.com, pub-3091494829711028, DIRECT, f08c47fec0942fa0
================================================
FILE: docs/index.html
================================================
INFO-SPIDER - 拿回你的个人信息
================================================
FILE: extension/index.css
================================================
.cnblog{
width:40px;
height: 40px;
border:0;
background:url(img/cnblog.png) no-repeat;
background-size: 100% 100%;
}
.github{
width:40px;
height: 40px;
border:0;
background:url(img/github.png) no-repeat;
background-size: 100% 100%;
}
.jianshu{
width:40px;
height: 40px;
border:0;
background:url(img/jianshu.png) no-repeat;
background-size: 100% 100%;
}
.oschina{
width:40px;
height: 40px;
border:0;
background:url(img/oschina.png) no-repeat;
background-size: 100% 100%;
}
.kuangjia{
width: 100px;
height: 100px;
}
================================================
FILE: extension/index.html
================================================
Document
================================================
FILE: extension/js/FileSaver.js
================================================
(function (global, factory) {
if (typeof define === "function" && define.amd) {
define([], factory);
} else if (typeof exports !== "undefined") {
factory();
} else {
var mod = {
exports: {}
};
factory();
global.FileSaver = mod.exports;
}
})(this, function () {
"use strict";
/*
* FileSaver.js
* A saveAs() FileSaver implementation.
*
* By Eli Grey, http://eligrey.com
*
* License : https://github.com/eligrey/FileSaver.js/blob/master/LICENSE.md (MIT)
* source : http://purl.eligrey.com/github/FileSaver.js
*/
// The one and only way of getting global scope in all environments
// https://stackoverflow.com/q/3277182/1008999
var _global = typeof window === 'object' && window.window === window ? window : typeof self === 'object' && self.self === self ? self : typeof global === 'object' && global.global === global ? global : void 0;
function bom(blob, opts) {
if (typeof opts === 'undefined') opts = {
autoBom: false
};else if (typeof opts !== 'object') {
console.warn('Deprecated: Expected third argument to be a object');
opts = {
autoBom: !opts
};
} // prepend BOM for UTF-8 XML and text/* types (including HTML)
// note: your browser will automatically convert UTF-16 U+FEFF to EF BB BF
if (opts.autoBom && /^\s*(?:text\/\S*|application\/xml|\S*\/\S*\+xml)\s*;.*charset\s*=\s*utf-8/i.test(blob.type)) {
return new Blob([String.fromCharCode(0xFEFF), blob], {
type: blob.type
});
}
return blob;
}
function download(url, name, opts) {
var xhr = new XMLHttpRequest();
xhr.open('GET', url);
xhr.responseType = 'blob';
xhr.onload = function () {
saveAs(xhr.response, name, opts);
};
xhr.onerror = function () {
console.error('could not download file');
};
xhr.send();
}
function corsEnabled(url) {
var xhr = new XMLHttpRequest(); // use sync to avoid popup blocker
xhr.open('HEAD', url, false);
try {
xhr.send();
} catch (e) {}
return xhr.status >= 200 && xhr.status <= 299;
} // `a.click()` doesn't work for all browsers (#465)
function click(node) {
try {
node.dispatchEvent(new MouseEvent('click'));
} catch (e) {
var evt = document.createEvent('MouseEvents');
evt.initMouseEvent('click', true, true, window, 0, 0, 0, 80, 20, false, false, false, false, 0, null);
node.dispatchEvent(evt);
}
} // Detect WebView inside a native macOS app by ruling out all browsers
// We just need to check for 'Safari' because all other browsers (besides Firefox) include that too
// https://www.whatismybrowser.com/guides/the-latest-user-agent/macos
var isMacOSWebView = _global.navigator && /Macintosh/.test(navigator.userAgent) && /AppleWebKit/.test(navigator.userAgent) && !/Safari/.test(navigator.userAgent);
var saveAs = _global.saveAs || ( // probably in some web worker
typeof window !== 'object' || window !== _global ? function saveAs() {}
/* noop */
// Use download attribute first if possible (#193 Lumia mobile) unless this is a macOS WebView
: 'download' in HTMLAnchorElement.prototype && !isMacOSWebView ? function saveAs(blob, name, opts) {
var URL = _global.URL || _global.webkitURL;
var a = document.createElement('a');
name = name || blob.name || 'download';
a.download = name;
a.rel = 'noopener'; // tabnabbing
// TODO: detect chrome extensions & packaged apps
// a.target = '_blank'
if (typeof blob === 'string') {
// Support regular links
a.href = blob;
if (a.origin !== location.origin) {
corsEnabled(a.href) ? download(blob, name, opts) : click(a, a.target = '_blank');
} else {
click(a);
}
} else {
// Support blobs
a.href = URL.createObjectURL(blob);
setTimeout(function () {
URL.revokeObjectURL(a.href);
}, 4E4); // 40s
setTimeout(function () {
click(a);
}, 0);
}
} // Use msSaveOrOpenBlob as a second approach
: 'msSaveOrOpenBlob' in navigator ? function saveAs(blob, name, opts) {
name = name || blob.name || 'download';
if (typeof blob === 'string') {
if (corsEnabled(blob)) {
download(blob, name, opts);
} else {
var a = document.createElement('a');
a.href = blob;
a.target = '_blank';
setTimeout(function () {
click(a);
});
}
} else {
navigator.msSaveOrOpenBlob(bom(blob, opts), name);
}
} // Fallback to using FileReader and a popup
: function saveAs(blob, name, opts, popup) {
// Open a popup immediately do go around popup blocker
// Mostly only available on user interaction and the fileReader is async so...
popup = popup || open('', '_blank');
if (popup) {
popup.document.title = popup.document.body.innerText = 'downloading...';
}
if (typeof blob === 'string') return download(blob, name, opts);
var force = blob.type === 'application/octet-stream';
var isSafari = /constructor/i.test(_global.HTMLElement) || _global.safari;
var isChromeIOS = /CriOS\/[\d]+/.test(navigator.userAgent);
if ((isChromeIOS || force && isSafari || isMacOSWebView) && typeof FileReader !== 'undefined') {
// Safari doesn't allow downloading of blob URLs
var reader = new FileReader();
reader.onloadend = function () {
var url = reader.result;
url = isChromeIOS ? url : url.replace(/^data:[^;]*;/, 'data:attachment/file;');
if (popup) popup.location.href = url;else location = url;
popup = null; // reverse-tabnabbing #460
};
reader.readAsDataURL(blob);
} else {
var URL = _global.URL || _global.webkitURL;
var url = URL.createObjectURL(blob);
if (popup) popup.location = url;else location.href = url;
popup = null; // reverse-tabnabbing #460
setTimeout(function () {
URL.revokeObjectURL(url);
}, 4E4); // 40s
}
});
_global.saveAs = saveAs.saveAs = saveAs;
if (typeof module !== 'undefined') {
module.exports = saveAs;
}
});
================================================
FILE: extension/js/cnblog/cnblogrun0.js
================================================
window.onload = function () {
chrome.storage.sync.get('cnblogname',function(budget){
var cnblog1="https://home.cnblogs.com/u/"+budget.cnblogname+"/";
window.open(cnblog1)
})
}
================================================
FILE: extension/js/cnblog/cnblogrun1.js
================================================
window.onload = function () {
// for(var i=0;i<10;i++)
// {
// console.log(document.getElementsByTagName('a')[i].outerHTML)
// console.log(js = document.getElementsByTagName('a')[i].getAttribute('href'));
// }
var data= Array();
for(var i=12;i<=14;i++)
{
console.log(document.getElementsByClassName('text_gray')[i-11].innerHTML)
data.push(document.getElementsByClassName('text_gray')[i-11].innerHTML)
var s=document.getElementsByTagName('li')[i].innerHTML;
var st="";
for(var j=0;j')
st="";
}
console.log(st)
data.push(st);
}
for(var i=6;i<=11;i++)
{
console.log(document.getElementsByTagName('span')[i].innerHTML)
data.push(document.getElementsByTagName('span')[i].innerHTML)
}
data.push("关注数")
data.push(document.getElementById('following_count').innerHTML)
data.push("粉丝数")
data.push(document.getElementById('follower_count').innerHTML)
console.log("关注数")
console.log(document.getElementById('following_count').innerHTML)
console.log("粉丝数")
console.log(document.getElementById('follower_count').innerHTML)
// var Divs = new Array();
// Divs= Array.from(document.getElementsByClassName("avatar_name"))
// console.log(Divs);
// console.log(document.getElementsByClassName("avatar_name"));
chrome.storage.sync.set({'user':data})
chrome.storage.sync.get('cnblogname',function(budget){
var cnblogurl2="https://www.cnblogs.com/"+budget.cnblogname+"/";
window.open(cnblogurl2)
})
}
================================================
FILE: extension/js/cnblog/cnblogrun2.js
================================================
(function (global, factory) {
if (typeof define === "function" && define.amd) {
define([], factory);
} else if (typeof exports !== "undefined") {
factory();
} else {
var mod = {
exports: {}
};
factory();
global.FileSaver = mod.exports;
}
})(this, function () {
"use strict";
/*
* FileSaver.js
* A saveAs() FileSaver implementation.
*
* By Eli Grey, http://eligrey.com
*
* License : https://github.com/eligrey/FileSaver.js/blob/master/LICENSE.md (MIT)
* source : http://purl.eligrey.com/github/FileSaver.js
*/
// The one and only way of getting global scope in all environments
// https://stackoverflow.com/q/3277182/1008999
var _global = typeof window === 'object' && window.window === window ? window : typeof self === 'object' && self.self === self ? self : typeof global === 'object' && global.global === global ? global : void 0;
function bom(blob, opts) {
if (typeof opts === 'undefined') opts = {
autoBom: false
};else if (typeof opts !== 'object') {
console.warn('Deprecated: Expected third argument to be a object');
opts = {
autoBom: !opts
};
} // prepend BOM for UTF-8 XML and text/* types (including HTML)
// note: your browser will automatically convert UTF-16 U+FEFF to EF BB BF
if (opts.autoBom && /^\s*(?:text\/\S*|application\/xml|\S*\/\S*\+xml)\s*;.*charset\s*=\s*utf-8/i.test(blob.type)) {
return new Blob([String.fromCharCode(0xFEFF), blob], {
type: blob.type
});
}
return blob;
}
function download(url, name, opts) {
var xhr = new XMLHttpRequest();
xhr.open('GET', url);
xhr.responseType = 'blob';
xhr.onload = function () {
saveAs(xhr.response, name, opts);
};
xhr.onerror = function () {
console.error('could not download file');
};
xhr.send();
}
function corsEnabled(url) {
var xhr = new XMLHttpRequest(); // use sync to avoid popup blocker
xhr.open('HEAD', url, false);
try {
xhr.send();
} catch (e) {}
return xhr.status >= 200 && xhr.status <= 299;
} // `a.click()` doesn't work for all browsers (#465)
function click(node) {
try {
node.dispatchEvent(new MouseEvent('click'));
} catch (e) {
var evt = document.createEvent('MouseEvents');
evt.initMouseEvent('click', true, true, window, 0, 0, 0, 80, 20, false, false, false, false, 0, null);
node.dispatchEvent(evt);
}
} // Detect WebView inside a native macOS app by ruling out all browsers
// We just need to check for 'Safari' because all other browsers (besides Firefox) include that too
// https://www.whatismybrowser.com/guides/the-latest-user-agent/macos
var isMacOSWebView = _global.navigator && /Macintosh/.test(navigator.userAgent) && /AppleWebKit/.test(navigator.userAgent) && !/Safari/.test(navigator.userAgent);
var saveAs = _global.saveAs || ( // probably in some web worker
typeof window !== 'object' || window !== _global ? function saveAs() {}
/* noop */
// Use download attribute first if possible (#193 Lumia mobile) unless this is a macOS WebView
: 'download' in HTMLAnchorElement.prototype && !isMacOSWebView ? function saveAs(blob, name, opts) {
var URL = _global.URL || _global.webkitURL;
var a = document.createElement('a');
name = name || blob.name || 'download';
a.download = name;
a.rel = 'noopener'; // tabnabbing
// TODO: detect chrome extensions & packaged apps
// a.target = '_blank'
if (typeof blob === 'string') {
// Support regular links
a.href = blob;
if (a.origin !== location.origin) {
corsEnabled(a.href) ? download(blob, name, opts) : click(a, a.target = '_blank');
} else {
click(a);
}
} else {
// Support blobs
a.href = URL.createObjectURL(blob);
setTimeout(function () {
URL.revokeObjectURL(a.href);
}, 4E4); // 40s
setTimeout(function () {
click(a);
}, 0);
}
} // Use msSaveOrOpenBlob as a second approach
: 'msSaveOrOpenBlob' in navigator ? function saveAs(blob, name, opts) {
name = name || blob.name || 'download';
if (typeof blob === 'string') {
if (corsEnabled(blob)) {
download(blob, name, opts);
} else {
var a = document.createElement('a');
a.href = blob;
a.target = '_blank';
setTimeout(function () {
click(a);
});
}
} else {
navigator.msSaveOrOpenBlob(bom(blob, opts), name);
}
} // Fallback to using FileReader and a popup
: function saveAs(blob, name, opts, popup) {
// Open a popup immediately do go around popup blocker
// Mostly only available on user interaction and the fileReader is async so...
popup = popup || open('', '_blank');
if (popup) {
popup.document.title = popup.document.body.innerText = 'downloading...';
}
if (typeof blob === 'string') return download(blob, name, opts);
var force = blob.type === 'application/octet-stream';
var isSafari = /constructor/i.test(_global.HTMLElement) || _global.safari;
var isChromeIOS = /CriOS\/[\d]+/.test(navigator.userAgent);
if ((isChromeIOS || force && isSafari || isMacOSWebView) && typeof FileReader !== 'undefined') {
// Safari doesn't allow downloading of blob URLs
var reader = new FileReader();
reader.onloadend = function () {
var url = reader.result;
url = isChromeIOS ? url : url.replace(/^data:[^;]*;/, 'data:attachment/file;');
if (popup) popup.location.href = url;else location = url;
popup = null; // reverse-tabnabbing #460
};
reader.readAsDataURL(blob);
} else {
var URL = _global.URL || _global.webkitURL;
var url = URL.createObjectURL(blob);
if (popup) popup.location = url;else location.href = url;
popup = null; // reverse-tabnabbing #460
setTimeout(function () {
URL.revokeObjectURL(url);
}, 4E4); // 40s
}
});
_global.saveAs = saveAs.saveAs = saveAs;
if (typeof module !== 'undefined') {
module.exports = saveAs;
}
});
window.onload = function () {
var data=new Array();
for(var i=0;i= 200 && xhr.status <= 299;
} // `a.click()` doesn't work for all browsers (#465)
function click(node) {
try {
node.dispatchEvent(new MouseEvent('click'));
} catch (e) {
var evt = document.createEvent('MouseEvents');
evt.initMouseEvent('click', true, true, window, 0, 0, 0, 80, 20, false, false, false, false, 0, null);
node.dispatchEvent(evt);
}
} // Detect WebView inside a native macOS app by ruling out all browsers
// We just need to check for 'Safari' because all other browsers (besides Firefox) include that too
// https://www.whatismybrowser.com/guides/the-latest-user-agent/macos
var isMacOSWebView = _global.navigator && /Macintosh/.test(navigator.userAgent) && /AppleWebKit/.test(navigator.userAgent) && !/Safari/.test(navigator.userAgent);
var saveAs = _global.saveAs || ( // probably in some web worker
typeof window !== 'object' || window !== _global ? function saveAs() {}
/* noop */
// Use download attribute first if possible (#193 Lumia mobile) unless this is a macOS WebView
: 'download' in HTMLAnchorElement.prototype && !isMacOSWebView ? function saveAs(blob, name, opts) {
var URL = _global.URL || _global.webkitURL;
var a = document.createElement('a');
name = name || blob.name || 'download';
a.download = name;
a.rel = 'noopener'; // tabnabbing
// TODO: detect chrome extensions & packaged apps
// a.target = '_blank'
if (typeof blob === 'string') {
// Support regular links
a.href = blob;
if (a.origin !== location.origin) {
corsEnabled(a.href) ? download(blob, name, opts) : click(a, a.target = '_blank');
} else {
click(a);
}
} else {
// Support blobs
a.href = URL.createObjectURL(blob);
setTimeout(function () {
URL.revokeObjectURL(a.href);
}, 4E4); // 40s
setTimeout(function () {
click(a);
}, 0);
}
} // Use msSaveOrOpenBlob as a second approach
: 'msSaveOrOpenBlob' in navigator ? function saveAs(blob, name, opts) {
name = name || blob.name || 'download';
if (typeof blob === 'string') {
if (corsEnabled(blob)) {
download(blob, name, opts);
} else {
var a = document.createElement('a');
a.href = blob;
a.target = '_blank';
setTimeout(function () {
click(a);
});
}
} else {
navigator.msSaveOrOpenBlob(bom(blob, opts), name);
}
} // Fallback to using FileReader and a popup
: function saveAs(blob, name, opts, popup) {
// Open a popup immediately do go around popup blocker
// Mostly only available on user interaction and the fileReader is async so...
popup = popup || open('', '_blank');
if (popup) {
popup.document.title = popup.document.body.innerText = 'downloading...';
}
if (typeof blob === 'string') return download(blob, name, opts);
var force = blob.type === 'application/octet-stream';
var isSafari = /constructor/i.test(_global.HTMLElement) || _global.safari;
var isChromeIOS = /CriOS\/[\d]+/.test(navigator.userAgent);
if ((isChromeIOS || force && isSafari || isMacOSWebView) && typeof FileReader !== 'undefined') {
// Safari doesn't allow downloading of blob URLs
var reader = new FileReader();
reader.onloadend = function () {
var url = reader.result;
url = isChromeIOS ? url : url.replace(/^data:[^;]*;/, 'data:attachment/file;');
if (popup) popup.location.href = url;else location = url;
popup = null; // reverse-tabnabbing #460
};
reader.readAsDataURL(blob);
} else {
var URL = _global.URL || _global.webkitURL;
var url = URL.createObjectURL(blob);
if (popup) popup.location = url;else location.href = url;
popup = null; // reverse-tabnabbing #460
setTimeout(function () {
URL.revokeObjectURL(url);
}, 4E4); // 40s
}
});
_global.saveAs = saveAs.saveAs = saveAs;
if (typeof module !== 'undefined') {
module.exports = saveAs;
}
});
window.onload = function () {
chrome.storage.sync.get('user',function(budget){
var blob = new Blob([budget.user], {type: "text/plain;charset=utf-8"});
saveAs(blob, "user.json");
})
chrome.storage.sync.get('following',function(budget){
var blob = new Blob([budget.following], {type: "text/plain;charset=utf-8"});
saveAs(blob, "following.json");
})
chrome.storage.sync.get('followers',function(budget){
var blob = new Blob([budget.followers], {type: "text/plain;charset=utf-8"});
saveAs(blob, "followers.json");
})
chrome.storage.sync.get('repos',function(budget){
var blob = new Blob([budget.repos], {type: "text/plain;charset=utf-8"});
saveAs(blob, "repos.json");
})
console.log(document.getElementsByTagName('pre')[0].innerHTML)
let data = document.getElementsByTagName('pre')[0].innerHTML;
var blob = new Blob([data], {type: "text/plain;charset=utf-8"});
saveAs(blob, "received_events.json");
// alert("爬取成功")
// window.close();
}
================================================
FILE: extension/js/index.js
================================================
window.onload = function () {
$('#github').click(function(){
var githubname=prompt("请输入用户名");
chrome.storage.sync.set({'githubname':githubname});
chrome.storage.sync.set({'flag':1});
var githuburl1="https://api.github.com/users/"+githubname;
// var githuburl2="https://api.github.com/users/"+githubname+"/following";
// var githuburl3="https://api.github.com/users/"+githubname+"/followers";
// var githuburl4="https://api.github.com/users/"+githubname+"/repos";
// var githuburl5="https://api.github.com/users/"+githubname+"/received_events";
window.open(githuburl1)
// chrome.storage.sync.set({ 'githubname': githubname })
})
$('#jianshu').click(function(){
var jianshu=prompt("请输入用户的主页链接");
var jianshuname="";
var j=0;
for(var i=0;i= 200 && xhr.status <= 299;
} // `a.click()` doesn't work for all browsers (#465)
function click(node) {
try {
node.dispatchEvent(new MouseEvent('click'));
} catch (e) {
var evt = document.createEvent('MouseEvents');
evt.initMouseEvent('click', true, true, window, 0, 0, 0, 80, 20, false, false, false, false, 0, null);
node.dispatchEvent(evt);
}
} // Detect WebView inside a native macOS app by ruling out all browsers
// We just need to check for 'Safari' because all other browsers (besides Firefox) include that too
// https://www.whatismybrowser.com/guides/the-latest-user-agent/macos
var isMacOSWebView = _global.navigator && /Macintosh/.test(navigator.userAgent) && /AppleWebKit/.test(navigator.userAgent) && !/Safari/.test(navigator.userAgent);
var saveAs = _global.saveAs || ( // probably in some web worker
typeof window !== 'object' || window !== _global ? function saveAs() {}
/* noop */
// Use download attribute first if possible (#193 Lumia mobile) unless this is a macOS WebView
: 'download' in HTMLAnchorElement.prototype && !isMacOSWebView ? function saveAs(blob, name, opts) {
var URL = _global.URL || _global.webkitURL;
var a = document.createElement('a');
name = name || blob.name || 'download';
a.download = name;
a.rel = 'noopener'; // tabnabbing
// TODO: detect chrome extensions & packaged apps
// a.target = '_blank'
if (typeof blob === 'string') {
// Support regular links
a.href = blob;
if (a.origin !== location.origin) {
corsEnabled(a.href) ? download(blob, name, opts) : click(a, a.target = '_blank');
} else {
click(a);
}
} else {
// Support blobs
a.href = URL.createObjectURL(blob);
setTimeout(function () {
URL.revokeObjectURL(a.href);
}, 4E4); // 40s
setTimeout(function () {
click(a);
}, 0);
}
} // Use msSaveOrOpenBlob as a second approach
: 'msSaveOrOpenBlob' in navigator ? function saveAs(blob, name, opts) {
name = name || blob.name || 'download';
if (typeof blob === 'string') {
if (corsEnabled(blob)) {
download(blob, name, opts);
} else {
var a = document.createElement('a');
a.href = blob;
a.target = '_blank';
setTimeout(function () {
click(a);
});
}
} else {
navigator.msSaveOrOpenBlob(bom(blob, opts), name);
}
} // Fallback to using FileReader and a popup
: function saveAs(blob, name, opts, popup) {
// Open a popup immediately do go around popup blocker
// Mostly only available on user interaction and the fileReader is async so...
popup = popup || open('', '_blank');
if (popup) {
popup.document.title = popup.document.body.innerText = 'downloading...';
}
if (typeof blob === 'string') return download(blob, name, opts);
var force = blob.type === 'application/octet-stream';
var isSafari = /constructor/i.test(_global.HTMLElement) || _global.safari;
var isChromeIOS = /CriOS\/[\d]+/.test(navigator.userAgent);
if ((isChromeIOS || force && isSafari || isMacOSWebView) && typeof FileReader !== 'undefined') {
// Safari doesn't allow downloading of blob URLs
var reader = new FileReader();
reader.onloadend = function () {
var url = reader.result;
url = isChromeIOS ? url : url.replace(/^data:[^;]*;/, 'data:attachment/file;');
if (popup) popup.location.href = url;else location = url;
popup = null; // reverse-tabnabbing #460
};
reader.readAsDataURL(blob);
} else {
var URL = _global.URL || _global.webkitURL;
var url = URL.createObjectURL(blob);
if (popup) popup.location = url;else location.href = url;
popup = null; // reverse-tabnabbing #460
setTimeout(function () {
URL.revokeObjectURL(url);
}, 4E4); // 40s
}
});
_global.saveAs = saveAs.saveAs = saveAs;
if (typeof module !== 'undefined') {
module.exports = saveAs;
}
});
window.onload = function () {
console.log(document.getElementsByTagName('pre')[0].innerHTML)
chrome.storage.sync.get('user',function(budget){
var blob = new Blob([budget.user], {type: "text/plain;charset=utf-8"});
saveAs(blob, "user.json");
})
var data=document.getElementsByTagName('pre')[0].innerHTML;
var blob = new Blob([data], {type: "text/plain;charset=utf-8"});
saveAs(blob, "public_notes.json");
}
================================================
FILE: extension/js/jquery.js
================================================
/*!
* jQuery JavaScript Library v3.6.0
* https://jquery.com/
*
* Includes Sizzle.js
* https://sizzlejs.com/
*
* Copyright OpenJS Foundation and other contributors
* Released under the MIT license
* https://jquery.org/license
*
* Date: 2021-03-02T17:08Z
*/
( function( global, factory ) {
"use strict";
if ( typeof module === "object" && typeof module.exports === "object" ) {
// For CommonJS and CommonJS-like environments where a proper `window`
// is present, execute the factory and get jQuery.
// For environments that do not have a `window` with a `document`
// (such as Node.js), expose a factory as module.exports.
// This accentuates the need for the creation of a real `window`.
// e.g. var jQuery = require("jquery")(window);
// See ticket #14549 for more info.
module.exports = global.document ?
factory( global, true ) :
function( w ) {
if ( !w.document ) {
throw new Error( "jQuery requires a window with a document" );
}
return factory( w );
};
} else {
factory( global );
}
// Pass this if window is not defined yet
} )( typeof window !== "undefined" ? window : this, function( window, noGlobal ) {
// Edge <= 12 - 13+, Firefox <=18 - 45+, IE 10 - 11, Safari 5.1 - 9+, iOS 6 - 9.1
// throw exceptions when non-strict code (e.g., ASP.NET 4.5) accesses strict mode
// arguments.callee.caller (trac-13335). But as of jQuery 3.0 (2016), strict mode should be common
// enough that all such attempts are guarded in a try block.
"use strict";
var arr = [];
var getProto = Object.getPrototypeOf;
var slice = arr.slice;
var flat = arr.flat ? function( array ) {
return arr.flat.call( array );
} : function( array ) {
return arr.concat.apply( [], array );
};
var push = arr.push;
var indexOf = arr.indexOf;
var class2type = {};
var toString = class2type.toString;
var hasOwn = class2type.hasOwnProperty;
var fnToString = hasOwn.toString;
var ObjectFunctionString = fnToString.call( Object );
var support = {};
var isFunction = function isFunction( obj ) {
// Support: Chrome <=57, Firefox <=52
// In some browsers, typeof returns "function" for HTML elements
// (i.e., `typeof document.createElement( "object" ) === "function"`).
// We don't want to classify *any* DOM node as a function.
// Support: QtWeb <=3.8.5, WebKit <=534.34, wkhtmltopdf tool <=0.12.5
// Plus for old WebKit, typeof returns "function" for HTML collections
// (e.g., `typeof document.getElementsByTagName("div") === "function"`). (gh-4756)
return typeof obj === "function" && typeof obj.nodeType !== "number" &&
typeof obj.item !== "function";
};
var isWindow = function isWindow( obj ) {
return obj != null && obj === obj.window;
};
var document = window.document;
var preservedScriptAttributes = {
type: true,
src: true,
nonce: true,
noModule: true
};
function DOMEval( code, node, doc ) {
doc = doc || document;
var i, val,
script = doc.createElement( "script" );
script.text = code;
if ( node ) {
for ( i in preservedScriptAttributes ) {
// Support: Firefox 64+, Edge 18+
// Some browsers don't support the "nonce" property on scripts.
// On the other hand, just using `getAttribute` is not enough as
// the `nonce` attribute is reset to an empty string whenever it
// becomes browsing-context connected.
// See https://github.com/whatwg/html/issues/2369
// See https://html.spec.whatwg.org/#nonce-attributes
// The `node.getAttribute` check was added for the sake of
// `jQuery.globalEval` so that it can fake a nonce-containing node
// via an object.
val = node[ i ] || node.getAttribute && node.getAttribute( i );
if ( val ) {
script.setAttribute( i, val );
}
}
}
doc.head.appendChild( script ).parentNode.removeChild( script );
}
function toType( obj ) {
if ( obj == null ) {
return obj + "";
}
// Support: Android <=2.3 only (functionish RegExp)
return typeof obj === "object" || typeof obj === "function" ?
class2type[ toString.call( obj ) ] || "object" :
typeof obj;
}
/* global Symbol */
// Defining this global in .eslintrc.json would create a danger of using the global
// unguarded in another place, it seems safer to define global only for this module
var
version = "3.6.0",
// Define a local copy of jQuery
jQuery = function( selector, context ) {
// The jQuery object is actually just the init constructor 'enhanced'
// Need init if jQuery is called (just allow error to be thrown if not included)
return new jQuery.fn.init( selector, context );
};
jQuery.fn = jQuery.prototype = {
// The current version of jQuery being used
jquery: version,
constructor: jQuery,
// The default length of a jQuery object is 0
length: 0,
toArray: function() {
return slice.call( this );
},
// Get the Nth element in the matched element set OR
// Get the whole matched element set as a clean array
get: function( num ) {
// Return all the elements in a clean array
if ( num == null ) {
return slice.call( this );
}
// Return just the one element from the set
return num < 0 ? this[ num + this.length ] : this[ num ];
},
// Take an array of elements and push it onto the stack
// (returning the new matched element set)
pushStack: function( elems ) {
// Build a new jQuery matched element set
var ret = jQuery.merge( this.constructor(), elems );
// Add the old object onto the stack (as a reference)
ret.prevObject = this;
// Return the newly-formed element set
return ret;
},
// Execute a callback for every element in the matched set.
each: function( callback ) {
return jQuery.each( this, callback );
},
map: function( callback ) {
return this.pushStack( jQuery.map( this, function( elem, i ) {
return callback.call( elem, i, elem );
} ) );
},
slice: function() {
return this.pushStack( slice.apply( this, arguments ) );
},
first: function() {
return this.eq( 0 );
},
last: function() {
return this.eq( -1 );
},
even: function() {
return this.pushStack( jQuery.grep( this, function( _elem, i ) {
return ( i + 1 ) % 2;
} ) );
},
odd: function() {
return this.pushStack( jQuery.grep( this, function( _elem, i ) {
return i % 2;
} ) );
},
eq: function( i ) {
var len = this.length,
j = +i + ( i < 0 ? len : 0 );
return this.pushStack( j >= 0 && j < len ? [ this[ j ] ] : [] );
},
end: function() {
return this.prevObject || this.constructor();
},
// For internal use only.
// Behaves like an Array's method, not like a jQuery method.
push: push,
sort: arr.sort,
splice: arr.splice
};
jQuery.extend = jQuery.fn.extend = function() {
var options, name, src, copy, copyIsArray, clone,
target = arguments[ 0 ] || {},
i = 1,
length = arguments.length,
deep = false;
// Handle a deep copy situation
if ( typeof target === "boolean" ) {
deep = target;
// Skip the boolean and the target
target = arguments[ i ] || {};
i++;
}
// Handle case when target is a string or something (possible in deep copy)
if ( typeof target !== "object" && !isFunction( target ) ) {
target = {};
}
// Extend jQuery itself if only one argument is passed
if ( i === length ) {
target = this;
i--;
}
for ( ; i < length; i++ ) {
// Only deal with non-null/undefined values
if ( ( options = arguments[ i ] ) != null ) {
// Extend the base object
for ( name in options ) {
copy = options[ name ];
// Prevent Object.prototype pollution
// Prevent never-ending loop
if ( name === "__proto__" || target === copy ) {
continue;
}
// Recurse if we're merging plain objects or arrays
if ( deep && copy && ( jQuery.isPlainObject( copy ) ||
( copyIsArray = Array.isArray( copy ) ) ) ) {
src = target[ name ];
// Ensure proper type for the source value
if ( copyIsArray && !Array.isArray( src ) ) {
clone = [];
} else if ( !copyIsArray && !jQuery.isPlainObject( src ) ) {
clone = {};
} else {
clone = src;
}
copyIsArray = false;
// Never move original objects, clone them
target[ name ] = jQuery.extend( deep, clone, copy );
// Don't bring in undefined values
} else if ( copy !== undefined ) {
target[ name ] = copy;
}
}
}
}
// Return the modified object
return target;
};
jQuery.extend( {
// Unique for each copy of jQuery on the page
expando: "jQuery" + ( version + Math.random() ).replace( /\D/g, "" ),
// Assume jQuery is ready without the ready module
isReady: true,
error: function( msg ) {
throw new Error( msg );
},
noop: function() {},
isPlainObject: function( obj ) {
var proto, Ctor;
// Detect obvious negatives
// Use toString instead of jQuery.type to catch host objects
if ( !obj || toString.call( obj ) !== "[object Object]" ) {
return false;
}
proto = getProto( obj );
// Objects with no prototype (e.g., `Object.create( null )`) are plain
if ( !proto ) {
return true;
}
// Objects with prototype are plain iff they were constructed by a global Object function
Ctor = hasOwn.call( proto, "constructor" ) && proto.constructor;
return typeof Ctor === "function" && fnToString.call( Ctor ) === ObjectFunctionString;
},
isEmptyObject: function( obj ) {
var name;
for ( name in obj ) {
return false;
}
return true;
},
// Evaluates a script in a provided context; falls back to the global one
// if not specified.
globalEval: function( code, options, doc ) {
DOMEval( code, { nonce: options && options.nonce }, doc );
},
each: function( obj, callback ) {
var length, i = 0;
if ( isArrayLike( obj ) ) {
length = obj.length;
for ( ; i < length; i++ ) {
if ( callback.call( obj[ i ], i, obj[ i ] ) === false ) {
break;
}
}
} else {
for ( i in obj ) {
if ( callback.call( obj[ i ], i, obj[ i ] ) === false ) {
break;
}
}
}
return obj;
},
// results is for internal usage only
makeArray: function( arr, results ) {
var ret = results || [];
if ( arr != null ) {
if ( isArrayLike( Object( arr ) ) ) {
jQuery.merge( ret,
typeof arr === "string" ?
[ arr ] : arr
);
} else {
push.call( ret, arr );
}
}
return ret;
},
inArray: function( elem, arr, i ) {
return arr == null ? -1 : indexOf.call( arr, elem, i );
},
// Support: Android <=4.0 only, PhantomJS 1 only
// push.apply(_, arraylike) throws on ancient WebKit
merge: function( first, second ) {
var len = +second.length,
j = 0,
i = first.length;
for ( ; j < len; j++ ) {
first[ i++ ] = second[ j ];
}
first.length = i;
return first;
},
grep: function( elems, callback, invert ) {
var callbackInverse,
matches = [],
i = 0,
length = elems.length,
callbackExpect = !invert;
// Go through the array, only saving the items
// that pass the validator function
for ( ; i < length; i++ ) {
callbackInverse = !callback( elems[ i ], i );
if ( callbackInverse !== callbackExpect ) {
matches.push( elems[ i ] );
}
}
return matches;
},
// arg is for internal usage only
map: function( elems, callback, arg ) {
var length, value,
i = 0,
ret = [];
// Go through the array, translating each of the items to their new values
if ( isArrayLike( elems ) ) {
length = elems.length;
for ( ; i < length; i++ ) {
value = callback( elems[ i ], i, arg );
if ( value != null ) {
ret.push( value );
}
}
// Go through every key on the object,
} else {
for ( i in elems ) {
value = callback( elems[ i ], i, arg );
if ( value != null ) {
ret.push( value );
}
}
}
// Flatten any nested arrays
return flat( ret );
},
// A global GUID counter for objects
guid: 1,
// jQuery.support is not used in Core but other projects attach their
// properties to it so it needs to exist.
support: support
} );
if ( typeof Symbol === "function" ) {
jQuery.fn[ Symbol.iterator ] = arr[ Symbol.iterator ];
}
// Populate the class2type map
jQuery.each( "Boolean Number String Function Array Date RegExp Object Error Symbol".split( " " ),
function( _i, name ) {
class2type[ "[object " + name + "]" ] = name.toLowerCase();
} );
function isArrayLike( obj ) {
// Support: real iOS 8.2 only (not reproducible in simulator)
// `in` check used to prevent JIT error (gh-2145)
// hasOwn isn't used here due to false negatives
// regarding Nodelist length in IE
var length = !!obj && "length" in obj && obj.length,
type = toType( obj );
if ( isFunction( obj ) || isWindow( obj ) ) {
return false;
}
return type === "array" || length === 0 ||
typeof length === "number" && length > 0 && ( length - 1 ) in obj;
}
var Sizzle =
/*!
* Sizzle CSS Selector Engine v2.3.6
* https://sizzlejs.com/
*
* Copyright JS Foundation and other contributors
* Released under the MIT license
* https://js.foundation/
*
* Date: 2021-02-16
*/
( function( window ) {
var i,
support,
Expr,
getText,
isXML,
tokenize,
compile,
select,
outermostContext,
sortInput,
hasDuplicate,
// Local document vars
setDocument,
document,
docElem,
documentIsHTML,
rbuggyQSA,
rbuggyMatches,
matches,
contains,
// Instance-specific data
expando = "sizzle" + 1 * new Date(),
preferredDoc = window.document,
dirruns = 0,
done = 0,
classCache = createCache(),
tokenCache = createCache(),
compilerCache = createCache(),
nonnativeSelectorCache = createCache(),
sortOrder = function( a, b ) {
if ( a === b ) {
hasDuplicate = true;
}
return 0;
},
// Instance methods
hasOwn = ( {} ).hasOwnProperty,
arr = [],
pop = arr.pop,
pushNative = arr.push,
push = arr.push,
slice = arr.slice,
// Use a stripped-down indexOf as it's faster than native
// https://jsperf.com/thor-indexof-vs-for/5
indexOf = function( list, elem ) {
var i = 0,
len = list.length;
for ( ; i < len; i++ ) {
if ( list[ i ] === elem ) {
return i;
}
}
return -1;
},
booleans = "checked|selected|async|autofocus|autoplay|controls|defer|disabled|hidden|" +
"ismap|loop|multiple|open|readonly|required|scoped",
// Regular expressions
// http://www.w3.org/TR/css3-selectors/#whitespace
whitespace = "[\\x20\\t\\r\\n\\f]",
// https://www.w3.org/TR/css-syntax-3/#ident-token-diagram
identifier = "(?:\\\\[\\da-fA-F]{1,6}" + whitespace +
"?|\\\\[^\\r\\n\\f]|[\\w-]|[^\0-\\x7f])+",
// Attribute selectors: http://www.w3.org/TR/selectors/#attribute-selectors
attributes = "\\[" + whitespace + "*(" + identifier + ")(?:" + whitespace +
// Operator (capture 2)
"*([*^$|!~]?=)" + whitespace +
// "Attribute values must be CSS identifiers [capture 5]
// or strings [capture 3 or capture 4]"
"*(?:'((?:\\\\.|[^\\\\'])*)'|\"((?:\\\\.|[^\\\\\"])*)\"|(" + identifier + "))|)" +
whitespace + "*\\]",
pseudos = ":(" + identifier + ")(?:\\((" +
// To reduce the number of selectors needing tokenize in the preFilter, prefer arguments:
// 1. quoted (capture 3; capture 4 or capture 5)
"('((?:\\\\.|[^\\\\'])*)'|\"((?:\\\\.|[^\\\\\"])*)\")|" +
// 2. simple (capture 6)
"((?:\\\\.|[^\\\\()[\\]]|" + attributes + ")*)|" +
// 3. anything else (capture 2)
".*" +
")\\)|)",
// Leading and non-escaped trailing whitespace, capturing some non-whitespace characters preceding the latter
rwhitespace = new RegExp( whitespace + "+", "g" ),
rtrim = new RegExp( "^" + whitespace + "+|((?:^|[^\\\\])(?:\\\\.)*)" +
whitespace + "+$", "g" ),
rcomma = new RegExp( "^" + whitespace + "*," + whitespace + "*" ),
rcombinators = new RegExp( "^" + whitespace + "*([>+~]|" + whitespace + ")" + whitespace +
"*" ),
rdescend = new RegExp( whitespace + "|>" ),
rpseudo = new RegExp( pseudos ),
ridentifier = new RegExp( "^" + identifier + "$" ),
matchExpr = {
"ID": new RegExp( "^#(" + identifier + ")" ),
"CLASS": new RegExp( "^\\.(" + identifier + ")" ),
"TAG": new RegExp( "^(" + identifier + "|[*])" ),
"ATTR": new RegExp( "^" + attributes ),
"PSEUDO": new RegExp( "^" + pseudos ),
"CHILD": new RegExp( "^:(only|first|last|nth|nth-last)-(child|of-type)(?:\\(" +
whitespace + "*(even|odd|(([+-]|)(\\d*)n|)" + whitespace + "*(?:([+-]|)" +
whitespace + "*(\\d+)|))" + whitespace + "*\\)|)", "i" ),
"bool": new RegExp( "^(?:" + booleans + ")$", "i" ),
// For use in libraries implementing .is()
// We use this for POS matching in `select`
"needsContext": new RegExp( "^" + whitespace +
"*[>+~]|:(even|odd|eq|gt|lt|nth|first|last)(?:\\(" + whitespace +
"*((?:-\\d)?\\d*)" + whitespace + "*\\)|)(?=[^-]|$)", "i" )
},
rhtml = /HTML$/i,
rinputs = /^(?:input|select|textarea|button)$/i,
rheader = /^h\d$/i,
rnative = /^[^{]+\{\s*\[native \w/,
// Easily-parseable/retrievable ID or TAG or CLASS selectors
rquickExpr = /^(?:#([\w-]+)|(\w+)|\.([\w-]+))$/,
rsibling = /[+~]/,
// CSS escapes
// http://www.w3.org/TR/CSS21/syndata.html#escaped-characters
runescape = new RegExp( "\\\\[\\da-fA-F]{1,6}" + whitespace + "?|\\\\([^\\r\\n\\f])", "g" ),
funescape = function( escape, nonHex ) {
var high = "0x" + escape.slice( 1 ) - 0x10000;
return nonHex ?
// Strip the backslash prefix from a non-hex escape sequence
nonHex :
// Replace a hexadecimal escape sequence with the encoded Unicode code point
// Support: IE <=11+
// For values outside the Basic Multilingual Plane (BMP), manually construct a
// surrogate pair
high < 0 ?
String.fromCharCode( high + 0x10000 ) :
String.fromCharCode( high >> 10 | 0xD800, high & 0x3FF | 0xDC00 );
},
// CSS string/identifier serialization
// https://drafts.csswg.org/cssom/#common-serializing-idioms
rcssescape = /([\0-\x1f\x7f]|^-?\d)|^-$|[^\0-\x1f\x7f-\uFFFF\w-]/g,
fcssescape = function( ch, asCodePoint ) {
if ( asCodePoint ) {
// U+0000 NULL becomes U+FFFD REPLACEMENT CHARACTER
if ( ch === "\0" ) {
return "\uFFFD";
}
// Control characters and (dependent upon position) numbers get escaped as code points
return ch.slice( 0, -1 ) + "\\" +
ch.charCodeAt( ch.length - 1 ).toString( 16 ) + " ";
}
// Other potentially-special ASCII characters get backslash-escaped
return "\\" + ch;
},
// Used for iframes
// See setDocument()
// Removing the function wrapper causes a "Permission Denied"
// error in IE
unloadHandler = function() {
setDocument();
},
inDisabledFieldset = addCombinator(
function( elem ) {
return elem.disabled === true && elem.nodeName.toLowerCase() === "fieldset";
},
{ dir: "parentNode", next: "legend" }
);
// Optimize for push.apply( _, NodeList )
try {
push.apply(
( arr = slice.call( preferredDoc.childNodes ) ),
preferredDoc.childNodes
);
// Support: Android<4.0
// Detect silently failing push.apply
// eslint-disable-next-line no-unused-expressions
arr[ preferredDoc.childNodes.length ].nodeType;
} catch ( e ) {
push = { apply: arr.length ?
// Leverage slice if possible
function( target, els ) {
pushNative.apply( target, slice.call( els ) );
} :
// Support: IE<9
// Otherwise append directly
function( target, els ) {
var j = target.length,
i = 0;
// Can't trust NodeList.length
while ( ( target[ j++ ] = els[ i++ ] ) ) {}
target.length = j - 1;
}
};
}
function Sizzle( selector, context, results, seed ) {
var m, i, elem, nid, match, groups, newSelector,
newContext = context && context.ownerDocument,
// nodeType defaults to 9, since context defaults to document
nodeType = context ? context.nodeType : 9;
results = results || [];
// Return early from calls with invalid selector or context
if ( typeof selector !== "string" || !selector ||
nodeType !== 1 && nodeType !== 9 && nodeType !== 11 ) {
return results;
}
// Try to shortcut find operations (as opposed to filters) in HTML documents
if ( !seed ) {
setDocument( context );
context = context || document;
if ( documentIsHTML ) {
// If the selector is sufficiently simple, try using a "get*By*" DOM method
// (excepting DocumentFragment context, where the methods don't exist)
if ( nodeType !== 11 && ( match = rquickExpr.exec( selector ) ) ) {
// ID selector
if ( ( m = match[ 1 ] ) ) {
// Document context
if ( nodeType === 9 ) {
if ( ( elem = context.getElementById( m ) ) ) {
// Support: IE, Opera, Webkit
// TODO: identify versions
// getElementById can match elements by name instead of ID
if ( elem.id === m ) {
results.push( elem );
return results;
}
} else {
return results;
}
// Element context
} else {
// Support: IE, Opera, Webkit
// TODO: identify versions
// getElementById can match elements by name instead of ID
if ( newContext && ( elem = newContext.getElementById( m ) ) &&
contains( context, elem ) &&
elem.id === m ) {
results.push( elem );
return results;
}
}
// Type selector
} else if ( match[ 2 ] ) {
push.apply( results, context.getElementsByTagName( selector ) );
return results;
// Class selector
} else if ( ( m = match[ 3 ] ) && support.getElementsByClassName &&
context.getElementsByClassName ) {
push.apply( results, context.getElementsByClassName( m ) );
return results;
}
}
// Take advantage of querySelectorAll
if ( support.qsa &&
!nonnativeSelectorCache[ selector + " " ] &&
( !rbuggyQSA || !rbuggyQSA.test( selector ) ) &&
// Support: IE 8 only
// Exclude object elements
( nodeType !== 1 || context.nodeName.toLowerCase() !== "object" ) ) {
newSelector = selector;
newContext = context;
// qSA considers elements outside a scoping root when evaluating child or
// descendant combinators, which is not what we want.
// In such cases, we work around the behavior by prefixing every selector in the
// list with an ID selector referencing the scope context.
// The technique has to be used as well when a leading combinator is used
// as such selectors are not recognized by querySelectorAll.
// Thanks to Andrew Dupont for this technique.
if ( nodeType === 1 &&
( rdescend.test( selector ) || rcombinators.test( selector ) ) ) {
// Expand context for sibling selectors
newContext = rsibling.test( selector ) && testContext( context.parentNode ) ||
context;
// We can use :scope instead of the ID hack if the browser
// supports it & if we're not changing the context.
if ( newContext !== context || !support.scope ) {
// Capture the context ID, setting it first if necessary
if ( ( nid = context.getAttribute( "id" ) ) ) {
nid = nid.replace( rcssescape, fcssescape );
} else {
context.setAttribute( "id", ( nid = expando ) );
}
}
// Prefix every selector in the list
groups = tokenize( selector );
i = groups.length;
while ( i-- ) {
groups[ i ] = ( nid ? "#" + nid : ":scope" ) + " " +
toSelector( groups[ i ] );
}
newSelector = groups.join( "," );
}
try {
push.apply( results,
newContext.querySelectorAll( newSelector )
);
return results;
} catch ( qsaError ) {
nonnativeSelectorCache( selector, true );
} finally {
if ( nid === expando ) {
context.removeAttribute( "id" );
}
}
}
}
}
// All others
return select( selector.replace( rtrim, "$1" ), context, results, seed );
}
/**
* Create key-value caches of limited size
* @returns {function(string, object)} Returns the Object data after storing it on itself with
* property name the (space-suffixed) string and (if the cache is larger than Expr.cacheLength)
* deleting the oldest entry
*/
function createCache() {
var keys = [];
function cache( key, value ) {
// Use (key + " ") to avoid collision with native prototype properties (see Issue #157)
if ( keys.push( key + " " ) > Expr.cacheLength ) {
// Only keep the most recent entries
delete cache[ keys.shift() ];
}
return ( cache[ key + " " ] = value );
}
return cache;
}
/**
* Mark a function for special use by Sizzle
* @param {Function} fn The function to mark
*/
function markFunction( fn ) {
fn[ expando ] = true;
return fn;
}
/**
* Support testing using an element
* @param {Function} fn Passed the created element and returns a boolean result
*/
function assert( fn ) {
var el = document.createElement( "fieldset" );
try {
return !!fn( el );
} catch ( e ) {
return false;
} finally {
// Remove from its parent by default
if ( el.parentNode ) {
el.parentNode.removeChild( el );
}
// release memory in IE
el = null;
}
}
/**
* Adds the same handler for all of the specified attrs
* @param {String} attrs Pipe-separated list of attributes
* @param {Function} handler The method that will be applied
*/
function addHandle( attrs, handler ) {
var arr = attrs.split( "|" ),
i = arr.length;
while ( i-- ) {
Expr.attrHandle[ arr[ i ] ] = handler;
}
}
/**
* Checks document order of two siblings
* @param {Element} a
* @param {Element} b
* @returns {Number} Returns less than 0 if a precedes b, greater than 0 if a follows b
*/
function siblingCheck( a, b ) {
var cur = b && a,
diff = cur && a.nodeType === 1 && b.nodeType === 1 &&
a.sourceIndex - b.sourceIndex;
// Use IE sourceIndex if available on both nodes
if ( diff ) {
return diff;
}
// Check if b follows a
if ( cur ) {
while ( ( cur = cur.nextSibling ) ) {
if ( cur === b ) {
return -1;
}
}
}
return a ? 1 : -1;
}
/**
* Returns a function to use in pseudos for input types
* @param {String} type
*/
function createInputPseudo( type ) {
return function( elem ) {
var name = elem.nodeName.toLowerCase();
return name === "input" && elem.type === type;
};
}
/**
* Returns a function to use in pseudos for buttons
* @param {String} type
*/
function createButtonPseudo( type ) {
return function( elem ) {
var name = elem.nodeName.toLowerCase();
return ( name === "input" || name === "button" ) && elem.type === type;
};
}
/**
* Returns a function to use in pseudos for :enabled/:disabled
* @param {Boolean} disabled true for :disabled; false for :enabled
*/
function createDisabledPseudo( disabled ) {
// Known :disabled false positives: fieldset[disabled] > legend:nth-of-type(n+2) :can-disable
return function( elem ) {
// Only certain elements can match :enabled or :disabled
// https://html.spec.whatwg.org/multipage/scripting.html#selector-enabled
// https://html.spec.whatwg.org/multipage/scripting.html#selector-disabled
if ( "form" in elem ) {
// Check for inherited disabledness on relevant non-disabled elements:
// * listed form-associated elements in a disabled fieldset
// https://html.spec.whatwg.org/multipage/forms.html#category-listed
// https://html.spec.whatwg.org/multipage/forms.html#concept-fe-disabled
// * option elements in a disabled optgroup
// https://html.spec.whatwg.org/multipage/forms.html#concept-option-disabled
// All such elements have a "form" property.
if ( elem.parentNode && elem.disabled === false ) {
// Option elements defer to a parent optgroup if present
if ( "label" in elem ) {
if ( "label" in elem.parentNode ) {
return elem.parentNode.disabled === disabled;
} else {
return elem.disabled === disabled;
}
}
// Support: IE 6 - 11
// Use the isDisabled shortcut property to check for disabled fieldset ancestors
return elem.isDisabled === disabled ||
// Where there is no isDisabled, check manually
/* jshint -W018 */
elem.isDisabled !== !disabled &&
inDisabledFieldset( elem ) === disabled;
}
return elem.disabled === disabled;
// Try to winnow out elements that can't be disabled before trusting the disabled property.
// Some victims get caught in our net (label, legend, menu, track), but it shouldn't
// even exist on them, let alone have a boolean value.
} else if ( "label" in elem ) {
return elem.disabled === disabled;
}
// Remaining elements are neither :enabled nor :disabled
return false;
};
}
/**
* Returns a function to use in pseudos for positionals
* @param {Function} fn
*/
function createPositionalPseudo( fn ) {
return markFunction( function( argument ) {
argument = +argument;
return markFunction( function( seed, matches ) {
var j,
matchIndexes = fn( [], seed.length, argument ),
i = matchIndexes.length;
// Match elements found at the specified indexes
while ( i-- ) {
if ( seed[ ( j = matchIndexes[ i ] ) ] ) {
seed[ j ] = !( matches[ j ] = seed[ j ] );
}
}
} );
} );
}
/**
* Checks a node for validity as a Sizzle context
* @param {Element|Object=} context
* @returns {Element|Object|Boolean} The input node if acceptable, otherwise a falsy value
*/
function testContext( context ) {
return context && typeof context.getElementsByTagName !== "undefined" && context;
}
// Expose support vars for convenience
support = Sizzle.support = {};
/**
* Detects XML nodes
* @param {Element|Object} elem An element or a document
* @returns {Boolean} True iff elem is a non-HTML XML node
*/
isXML = Sizzle.isXML = function( elem ) {
var namespace = elem && elem.namespaceURI,
docElem = elem && ( elem.ownerDocument || elem ).documentElement;
// Support: IE <=8
// Assume HTML when documentElement doesn't yet exist, such as inside loading iframes
// https://bugs.jquery.com/ticket/4833
return !rhtml.test( namespace || docElem && docElem.nodeName || "HTML" );
};
/**
* Sets document-related variables once based on the current document
* @param {Element|Object} [doc] An element or document object to use to set the document
* @returns {Object} Returns the current document
*/
setDocument = Sizzle.setDocument = function( node ) {
var hasCompare, subWindow,
doc = node ? node.ownerDocument || node : preferredDoc;
// Return early if doc is invalid or already selected
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
if ( doc == document || doc.nodeType !== 9 || !doc.documentElement ) {
return document;
}
// Update global variables
document = doc;
docElem = document.documentElement;
documentIsHTML = !isXML( document );
// Support: IE 9 - 11+, Edge 12 - 18+
// Accessing iframe documents after unload throws "permission denied" errors (jQuery #13936)
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
if ( preferredDoc != document &&
( subWindow = document.defaultView ) && subWindow.top !== subWindow ) {
// Support: IE 11, Edge
if ( subWindow.addEventListener ) {
subWindow.addEventListener( "unload", unloadHandler, false );
// Support: IE 9 - 10 only
} else if ( subWindow.attachEvent ) {
subWindow.attachEvent( "onunload", unloadHandler );
}
}
// Support: IE 8 - 11+, Edge 12 - 18+, Chrome <=16 - 25 only, Firefox <=3.6 - 31 only,
// Safari 4 - 5 only, Opera <=11.6 - 12.x only
// IE/Edge & older browsers don't support the :scope pseudo-class.
// Support: Safari 6.0 only
// Safari 6.0 supports :scope but it's an alias of :root there.
support.scope = assert( function( el ) {
docElem.appendChild( el ).appendChild( document.createElement( "div" ) );
return typeof el.querySelectorAll !== "undefined" &&
!el.querySelectorAll( ":scope fieldset div" ).length;
} );
/* Attributes
---------------------------------------------------------------------- */
// Support: IE<8
// Verify that getAttribute really returns attributes and not properties
// (excepting IE8 booleans)
support.attributes = assert( function( el ) {
el.className = "i";
return !el.getAttribute( "className" );
} );
/* getElement(s)By*
---------------------------------------------------------------------- */
// Check if getElementsByTagName("*") returns only elements
support.getElementsByTagName = assert( function( el ) {
el.appendChild( document.createComment( "" ) );
return !el.getElementsByTagName( "*" ).length;
} );
// Support: IE<9
support.getElementsByClassName = rnative.test( document.getElementsByClassName );
// Support: IE<10
// Check if getElementById returns elements by name
// The broken getElementById methods don't pick up programmatically-set names,
// so use a roundabout getElementsByName test
support.getById = assert( function( el ) {
docElem.appendChild( el ).id = expando;
return !document.getElementsByName || !document.getElementsByName( expando ).length;
} );
// ID filter and find
if ( support.getById ) {
Expr.filter[ "ID" ] = function( id ) {
var attrId = id.replace( runescape, funescape );
return function( elem ) {
return elem.getAttribute( "id" ) === attrId;
};
};
Expr.find[ "ID" ] = function( id, context ) {
if ( typeof context.getElementById !== "undefined" && documentIsHTML ) {
var elem = context.getElementById( id );
return elem ? [ elem ] : [];
}
};
} else {
Expr.filter[ "ID" ] = function( id ) {
var attrId = id.replace( runescape, funescape );
return function( elem ) {
var node = typeof elem.getAttributeNode !== "undefined" &&
elem.getAttributeNode( "id" );
return node && node.value === attrId;
};
};
// Support: IE 6 - 7 only
// getElementById is not reliable as a find shortcut
Expr.find[ "ID" ] = function( id, context ) {
if ( typeof context.getElementById !== "undefined" && documentIsHTML ) {
var node, i, elems,
elem = context.getElementById( id );
if ( elem ) {
// Verify the id attribute
node = elem.getAttributeNode( "id" );
if ( node && node.value === id ) {
return [ elem ];
}
// Fall back on getElementsByName
elems = context.getElementsByName( id );
i = 0;
while ( ( elem = elems[ i++ ] ) ) {
node = elem.getAttributeNode( "id" );
if ( node && node.value === id ) {
return [ elem ];
}
}
}
return [];
}
};
}
// Tag
Expr.find[ "TAG" ] = support.getElementsByTagName ?
function( tag, context ) {
if ( typeof context.getElementsByTagName !== "undefined" ) {
return context.getElementsByTagName( tag );
// DocumentFragment nodes don't have gEBTN
} else if ( support.qsa ) {
return context.querySelectorAll( tag );
}
} :
function( tag, context ) {
var elem,
tmp = [],
i = 0,
// By happy coincidence, a (broken) gEBTN appears on DocumentFragment nodes too
results = context.getElementsByTagName( tag );
// Filter out possible comments
if ( tag === "*" ) {
while ( ( elem = results[ i++ ] ) ) {
if ( elem.nodeType === 1 ) {
tmp.push( elem );
}
}
return tmp;
}
return results;
};
// Class
Expr.find[ "CLASS" ] = support.getElementsByClassName && function( className, context ) {
if ( typeof context.getElementsByClassName !== "undefined" && documentIsHTML ) {
return context.getElementsByClassName( className );
}
};
/* QSA/matchesSelector
---------------------------------------------------------------------- */
// QSA and matchesSelector support
// matchesSelector(:active) reports false when true (IE9/Opera 11.5)
rbuggyMatches = [];
// qSa(:focus) reports false when true (Chrome 21)
// We allow this because of a bug in IE8/9 that throws an error
// whenever `document.activeElement` is accessed on an iframe
// So, we allow :focus to pass through QSA all the time to avoid the IE error
// See https://bugs.jquery.com/ticket/13378
rbuggyQSA = [];
if ( ( support.qsa = rnative.test( document.querySelectorAll ) ) ) {
// Build QSA regex
// Regex strategy adopted from Diego Perini
assert( function( el ) {
var input;
// Select is set to empty string on purpose
// This is to test IE's treatment of not explicitly
// setting a boolean content attribute,
// since its presence should be enough
// https://bugs.jquery.com/ticket/12359
docElem.appendChild( el ).innerHTML = " " +
"" +
" ";
// Support: IE8, Opera 11-12.16
// Nothing should be selected when empty strings follow ^= or $= or *=
// The test attribute must be unknown in Opera but "safe" for WinRT
// https://msdn.microsoft.com/en-us/library/ie/hh465388.aspx#attribute_section
if ( el.querySelectorAll( "[msallowcapture^='']" ).length ) {
rbuggyQSA.push( "[*^$]=" + whitespace + "*(?:''|\"\")" );
}
// Support: IE8
// Boolean attributes and "value" are not treated correctly
if ( !el.querySelectorAll( "[selected]" ).length ) {
rbuggyQSA.push( "\\[" + whitespace + "*(?:value|" + booleans + ")" );
}
// Support: Chrome<29, Android<4.4, Safari<7.0+, iOS<7.0+, PhantomJS<1.9.8+
if ( !el.querySelectorAll( "[id~=" + expando + "-]" ).length ) {
rbuggyQSA.push( "~=" );
}
// Support: IE 11+, Edge 15 - 18+
// IE 11/Edge don't find elements on a `[name='']` query in some cases.
// Adding a temporary attribute to the document before the selection works
// around the issue.
// Interestingly, IE 10 & older don't seem to have the issue.
input = document.createElement( "input" );
input.setAttribute( "name", "" );
el.appendChild( input );
if ( !el.querySelectorAll( "[name='']" ).length ) {
rbuggyQSA.push( "\\[" + whitespace + "*name" + whitespace + "*=" +
whitespace + "*(?:''|\"\")" );
}
// Webkit/Opera - :checked should return selected option elements
// http://www.w3.org/TR/2011/REC-css3-selectors-20110929/#checked
// IE8 throws error here and will not see later tests
if ( !el.querySelectorAll( ":checked" ).length ) {
rbuggyQSA.push( ":checked" );
}
// Support: Safari 8+, iOS 8+
// https://bugs.webkit.org/show_bug.cgi?id=136851
// In-page `selector#id sibling-combinator selector` fails
if ( !el.querySelectorAll( "a#" + expando + "+*" ).length ) {
rbuggyQSA.push( ".#.+[+~]" );
}
// Support: Firefox <=3.6 - 5 only
// Old Firefox doesn't throw on a badly-escaped identifier.
el.querySelectorAll( "\\\f" );
rbuggyQSA.push( "[\\r\\n\\f]" );
} );
assert( function( el ) {
el.innerHTML = " " +
" ";
// Support: Windows 8 Native Apps
// The type and name attributes are restricted during .innerHTML assignment
var input = document.createElement( "input" );
input.setAttribute( "type", "hidden" );
el.appendChild( input ).setAttribute( "name", "D" );
// Support: IE8
// Enforce case-sensitivity of name attribute
if ( el.querySelectorAll( "[name=d]" ).length ) {
rbuggyQSA.push( "name" + whitespace + "*[*^$|!~]?=" );
}
// FF 3.5 - :enabled/:disabled and hidden elements (hidden elements are still enabled)
// IE8 throws error here and will not see later tests
if ( el.querySelectorAll( ":enabled" ).length !== 2 ) {
rbuggyQSA.push( ":enabled", ":disabled" );
}
// Support: IE9-11+
// IE's :disabled selector does not pick up the children of disabled fieldsets
docElem.appendChild( el ).disabled = true;
if ( el.querySelectorAll( ":disabled" ).length !== 2 ) {
rbuggyQSA.push( ":enabled", ":disabled" );
}
// Support: Opera 10 - 11 only
// Opera 10-11 does not throw on post-comma invalid pseudos
el.querySelectorAll( "*,:x" );
rbuggyQSA.push( ",.*:" );
} );
}
if ( ( support.matchesSelector = rnative.test( ( matches = docElem.matches ||
docElem.webkitMatchesSelector ||
docElem.mozMatchesSelector ||
docElem.oMatchesSelector ||
docElem.msMatchesSelector ) ) ) ) {
assert( function( el ) {
// Check to see if it's possible to do matchesSelector
// on a disconnected node (IE 9)
support.disconnectedMatch = matches.call( el, "*" );
// This should fail with an exception
// Gecko does not error, returns false instead
matches.call( el, "[s!='']:x" );
rbuggyMatches.push( "!=", pseudos );
} );
}
rbuggyQSA = rbuggyQSA.length && new RegExp( rbuggyQSA.join( "|" ) );
rbuggyMatches = rbuggyMatches.length && new RegExp( rbuggyMatches.join( "|" ) );
/* Contains
---------------------------------------------------------------------- */
hasCompare = rnative.test( docElem.compareDocumentPosition );
// Element contains another
// Purposefully self-exclusive
// As in, an element does not contain itself
contains = hasCompare || rnative.test( docElem.contains ) ?
function( a, b ) {
var adown = a.nodeType === 9 ? a.documentElement : a,
bup = b && b.parentNode;
return a === bup || !!( bup && bup.nodeType === 1 && (
adown.contains ?
adown.contains( bup ) :
a.compareDocumentPosition && a.compareDocumentPosition( bup ) & 16
) );
} :
function( a, b ) {
if ( b ) {
while ( ( b = b.parentNode ) ) {
if ( b === a ) {
return true;
}
}
}
return false;
};
/* Sorting
---------------------------------------------------------------------- */
// Document order sorting
sortOrder = hasCompare ?
function( a, b ) {
// Flag for duplicate removal
if ( a === b ) {
hasDuplicate = true;
return 0;
}
// Sort on method existence if only one input has compareDocumentPosition
var compare = !a.compareDocumentPosition - !b.compareDocumentPosition;
if ( compare ) {
return compare;
}
// Calculate position if both inputs belong to the same document
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
compare = ( a.ownerDocument || a ) == ( b.ownerDocument || b ) ?
a.compareDocumentPosition( b ) :
// Otherwise we know they are disconnected
1;
// Disconnected nodes
if ( compare & 1 ||
( !support.sortDetached && b.compareDocumentPosition( a ) === compare ) ) {
// Choose the first element that is related to our preferred document
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
if ( a == document || a.ownerDocument == preferredDoc &&
contains( preferredDoc, a ) ) {
return -1;
}
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
if ( b == document || b.ownerDocument == preferredDoc &&
contains( preferredDoc, b ) ) {
return 1;
}
// Maintain original order
return sortInput ?
( indexOf( sortInput, a ) - indexOf( sortInput, b ) ) :
0;
}
return compare & 4 ? -1 : 1;
} :
function( a, b ) {
// Exit early if the nodes are identical
if ( a === b ) {
hasDuplicate = true;
return 0;
}
var cur,
i = 0,
aup = a.parentNode,
bup = b.parentNode,
ap = [ a ],
bp = [ b ];
// Parentless nodes are either documents or disconnected
if ( !aup || !bup ) {
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
/* eslint-disable eqeqeq */
return a == document ? -1 :
b == document ? 1 :
/* eslint-enable eqeqeq */
aup ? -1 :
bup ? 1 :
sortInput ?
( indexOf( sortInput, a ) - indexOf( sortInput, b ) ) :
0;
// If the nodes are siblings, we can do a quick check
} else if ( aup === bup ) {
return siblingCheck( a, b );
}
// Otherwise we need full lists of their ancestors for comparison
cur = a;
while ( ( cur = cur.parentNode ) ) {
ap.unshift( cur );
}
cur = b;
while ( ( cur = cur.parentNode ) ) {
bp.unshift( cur );
}
// Walk down the tree looking for a discrepancy
while ( ap[ i ] === bp[ i ] ) {
i++;
}
return i ?
// Do a sibling check if the nodes have a common ancestor
siblingCheck( ap[ i ], bp[ i ] ) :
// Otherwise nodes in our document sort first
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
/* eslint-disable eqeqeq */
ap[ i ] == preferredDoc ? -1 :
bp[ i ] == preferredDoc ? 1 :
/* eslint-enable eqeqeq */
0;
};
return document;
};
Sizzle.matches = function( expr, elements ) {
return Sizzle( expr, null, null, elements );
};
Sizzle.matchesSelector = function( elem, expr ) {
setDocument( elem );
if ( support.matchesSelector && documentIsHTML &&
!nonnativeSelectorCache[ expr + " " ] &&
( !rbuggyMatches || !rbuggyMatches.test( expr ) ) &&
( !rbuggyQSA || !rbuggyQSA.test( expr ) ) ) {
try {
var ret = matches.call( elem, expr );
// IE 9's matchesSelector returns false on disconnected nodes
if ( ret || support.disconnectedMatch ||
// As well, disconnected nodes are said to be in a document
// fragment in IE 9
elem.document && elem.document.nodeType !== 11 ) {
return ret;
}
} catch ( e ) {
nonnativeSelectorCache( expr, true );
}
}
return Sizzle( expr, document, null, [ elem ] ).length > 0;
};
Sizzle.contains = function( context, elem ) {
// Set document vars if needed
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
if ( ( context.ownerDocument || context ) != document ) {
setDocument( context );
}
return contains( context, elem );
};
Sizzle.attr = function( elem, name ) {
// Set document vars if needed
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
if ( ( elem.ownerDocument || elem ) != document ) {
setDocument( elem );
}
var fn = Expr.attrHandle[ name.toLowerCase() ],
// Don't get fooled by Object.prototype properties (jQuery #13807)
val = fn && hasOwn.call( Expr.attrHandle, name.toLowerCase() ) ?
fn( elem, name, !documentIsHTML ) :
undefined;
return val !== undefined ?
val :
support.attributes || !documentIsHTML ?
elem.getAttribute( name ) :
( val = elem.getAttributeNode( name ) ) && val.specified ?
val.value :
null;
};
Sizzle.escape = function( sel ) {
return ( sel + "" ).replace( rcssescape, fcssescape );
};
Sizzle.error = function( msg ) {
throw new Error( "Syntax error, unrecognized expression: " + msg );
};
/**
* Document sorting and removing duplicates
* @param {ArrayLike} results
*/
Sizzle.uniqueSort = function( results ) {
var elem,
duplicates = [],
j = 0,
i = 0;
// Unless we *know* we can detect duplicates, assume their presence
hasDuplicate = !support.detectDuplicates;
sortInput = !support.sortStable && results.slice( 0 );
results.sort( sortOrder );
if ( hasDuplicate ) {
while ( ( elem = results[ i++ ] ) ) {
if ( elem === results[ i ] ) {
j = duplicates.push( i );
}
}
while ( j-- ) {
results.splice( duplicates[ j ], 1 );
}
}
// Clear input after sorting to release objects
// See https://github.com/jquery/sizzle/pull/225
sortInput = null;
return results;
};
/**
* Utility function for retrieving the text value of an array of DOM nodes
* @param {Array|Element} elem
*/
getText = Sizzle.getText = function( elem ) {
var node,
ret = "",
i = 0,
nodeType = elem.nodeType;
if ( !nodeType ) {
// If no nodeType, this is expected to be an array
while ( ( node = elem[ i++ ] ) ) {
// Do not traverse comment nodes
ret += getText( node );
}
} else if ( nodeType === 1 || nodeType === 9 || nodeType === 11 ) {
// Use textContent for elements
// innerText usage removed for consistency of new lines (jQuery #11153)
if ( typeof elem.textContent === "string" ) {
return elem.textContent;
} else {
// Traverse its children
for ( elem = elem.firstChild; elem; elem = elem.nextSibling ) {
ret += getText( elem );
}
}
} else if ( nodeType === 3 || nodeType === 4 ) {
return elem.nodeValue;
}
// Do not include comment or processing instruction nodes
return ret;
};
Expr = Sizzle.selectors = {
// Can be adjusted by the user
cacheLength: 50,
createPseudo: markFunction,
match: matchExpr,
attrHandle: {},
find: {},
relative: {
">": { dir: "parentNode", first: true },
" ": { dir: "parentNode" },
"+": { dir: "previousSibling", first: true },
"~": { dir: "previousSibling" }
},
preFilter: {
"ATTR": function( match ) {
match[ 1 ] = match[ 1 ].replace( runescape, funescape );
// Move the given value to match[3] whether quoted or unquoted
match[ 3 ] = ( match[ 3 ] || match[ 4 ] ||
match[ 5 ] || "" ).replace( runescape, funescape );
if ( match[ 2 ] === "~=" ) {
match[ 3 ] = " " + match[ 3 ] + " ";
}
return match.slice( 0, 4 );
},
"CHILD": function( match ) {
/* matches from matchExpr["CHILD"]
1 type (only|nth|...)
2 what (child|of-type)
3 argument (even|odd|\d*|\d*n([+-]\d+)?|...)
4 xn-component of xn+y argument ([+-]?\d*n|)
5 sign of xn-component
6 x of xn-component
7 sign of y-component
8 y of y-component
*/
match[ 1 ] = match[ 1 ].toLowerCase();
if ( match[ 1 ].slice( 0, 3 ) === "nth" ) {
// nth-* requires argument
if ( !match[ 3 ] ) {
Sizzle.error( match[ 0 ] );
}
// numeric x and y parameters for Expr.filter.CHILD
// remember that false/true cast respectively to 0/1
match[ 4 ] = +( match[ 4 ] ?
match[ 5 ] + ( match[ 6 ] || 1 ) :
2 * ( match[ 3 ] === "even" || match[ 3 ] === "odd" ) );
match[ 5 ] = +( ( match[ 7 ] + match[ 8 ] ) || match[ 3 ] === "odd" );
// other types prohibit arguments
} else if ( match[ 3 ] ) {
Sizzle.error( match[ 0 ] );
}
return match;
},
"PSEUDO": function( match ) {
var excess,
unquoted = !match[ 6 ] && match[ 2 ];
if ( matchExpr[ "CHILD" ].test( match[ 0 ] ) ) {
return null;
}
// Accept quoted arguments as-is
if ( match[ 3 ] ) {
match[ 2 ] = match[ 4 ] || match[ 5 ] || "";
// Strip excess characters from unquoted arguments
} else if ( unquoted && rpseudo.test( unquoted ) &&
// Get excess from tokenize (recursively)
( excess = tokenize( unquoted, true ) ) &&
// advance to the next closing parenthesis
( excess = unquoted.indexOf( ")", unquoted.length - excess ) - unquoted.length ) ) {
// excess is a negative index
match[ 0 ] = match[ 0 ].slice( 0, excess );
match[ 2 ] = unquoted.slice( 0, excess );
}
// Return only captures needed by the pseudo filter method (type and argument)
return match.slice( 0, 3 );
}
},
filter: {
"TAG": function( nodeNameSelector ) {
var nodeName = nodeNameSelector.replace( runescape, funescape ).toLowerCase();
return nodeNameSelector === "*" ?
function() {
return true;
} :
function( elem ) {
return elem.nodeName && elem.nodeName.toLowerCase() === nodeName;
};
},
"CLASS": function( className ) {
var pattern = classCache[ className + " " ];
return pattern ||
( pattern = new RegExp( "(^|" + whitespace +
")" + className + "(" + whitespace + "|$)" ) ) && classCache(
className, function( elem ) {
return pattern.test(
typeof elem.className === "string" && elem.className ||
typeof elem.getAttribute !== "undefined" &&
elem.getAttribute( "class" ) ||
""
);
} );
},
"ATTR": function( name, operator, check ) {
return function( elem ) {
var result = Sizzle.attr( elem, name );
if ( result == null ) {
return operator === "!=";
}
if ( !operator ) {
return true;
}
result += "";
/* eslint-disable max-len */
return operator === "=" ? result === check :
operator === "!=" ? result !== check :
operator === "^=" ? check && result.indexOf( check ) === 0 :
operator === "*=" ? check && result.indexOf( check ) > -1 :
operator === "$=" ? check && result.slice( -check.length ) === check :
operator === "~=" ? ( " " + result.replace( rwhitespace, " " ) + " " ).indexOf( check ) > -1 :
operator === "|=" ? result === check || result.slice( 0, check.length + 1 ) === check + "-" :
false;
/* eslint-enable max-len */
};
},
"CHILD": function( type, what, _argument, first, last ) {
var simple = type.slice( 0, 3 ) !== "nth",
forward = type.slice( -4 ) !== "last",
ofType = what === "of-type";
return first === 1 && last === 0 ?
// Shortcut for :nth-*(n)
function( elem ) {
return !!elem.parentNode;
} :
function( elem, _context, xml ) {
var cache, uniqueCache, outerCache, node, nodeIndex, start,
dir = simple !== forward ? "nextSibling" : "previousSibling",
parent = elem.parentNode,
name = ofType && elem.nodeName.toLowerCase(),
useCache = !xml && !ofType,
diff = false;
if ( parent ) {
// :(first|last|only)-(child|of-type)
if ( simple ) {
while ( dir ) {
node = elem;
while ( ( node = node[ dir ] ) ) {
if ( ofType ?
node.nodeName.toLowerCase() === name :
node.nodeType === 1 ) {
return false;
}
}
// Reverse direction for :only-* (if we haven't yet done so)
start = dir = type === "only" && !start && "nextSibling";
}
return true;
}
start = [ forward ? parent.firstChild : parent.lastChild ];
// non-xml :nth-child(...) stores cache data on `parent`
if ( forward && useCache ) {
// Seek `elem` from a previously-cached index
// ...in a gzip-friendly way
node = parent;
outerCache = node[ expando ] || ( node[ expando ] = {} );
// Support: IE <9 only
// Defend against cloned attroperties (jQuery gh-1709)
uniqueCache = outerCache[ node.uniqueID ] ||
( outerCache[ node.uniqueID ] = {} );
cache = uniqueCache[ type ] || [];
nodeIndex = cache[ 0 ] === dirruns && cache[ 1 ];
diff = nodeIndex && cache[ 2 ];
node = nodeIndex && parent.childNodes[ nodeIndex ];
while ( ( node = ++nodeIndex && node && node[ dir ] ||
// Fallback to seeking `elem` from the start
( diff = nodeIndex = 0 ) || start.pop() ) ) {
// When found, cache indexes on `parent` and break
if ( node.nodeType === 1 && ++diff && node === elem ) {
uniqueCache[ type ] = [ dirruns, nodeIndex, diff ];
break;
}
}
} else {
// Use previously-cached element index if available
if ( useCache ) {
// ...in a gzip-friendly way
node = elem;
outerCache = node[ expando ] || ( node[ expando ] = {} );
// Support: IE <9 only
// Defend against cloned attroperties (jQuery gh-1709)
uniqueCache = outerCache[ node.uniqueID ] ||
( outerCache[ node.uniqueID ] = {} );
cache = uniqueCache[ type ] || [];
nodeIndex = cache[ 0 ] === dirruns && cache[ 1 ];
diff = nodeIndex;
}
// xml :nth-child(...)
// or :nth-last-child(...) or :nth(-last)?-of-type(...)
if ( diff === false ) {
// Use the same loop as above to seek `elem` from the start
while ( ( node = ++nodeIndex && node && node[ dir ] ||
( diff = nodeIndex = 0 ) || start.pop() ) ) {
if ( ( ofType ?
node.nodeName.toLowerCase() === name :
node.nodeType === 1 ) &&
++diff ) {
// Cache the index of each encountered element
if ( useCache ) {
outerCache = node[ expando ] ||
( node[ expando ] = {} );
// Support: IE <9 only
// Defend against cloned attroperties (jQuery gh-1709)
uniqueCache = outerCache[ node.uniqueID ] ||
( outerCache[ node.uniqueID ] = {} );
uniqueCache[ type ] = [ dirruns, diff ];
}
if ( node === elem ) {
break;
}
}
}
}
}
// Incorporate the offset, then check against cycle size
diff -= last;
return diff === first || ( diff % first === 0 && diff / first >= 0 );
}
};
},
"PSEUDO": function( pseudo, argument ) {
// pseudo-class names are case-insensitive
// http://www.w3.org/TR/selectors/#pseudo-classes
// Prioritize by case sensitivity in case custom pseudos are added with uppercase letters
// Remember that setFilters inherits from pseudos
var args,
fn = Expr.pseudos[ pseudo ] || Expr.setFilters[ pseudo.toLowerCase() ] ||
Sizzle.error( "unsupported pseudo: " + pseudo );
// The user may use createPseudo to indicate that
// arguments are needed to create the filter function
// just as Sizzle does
if ( fn[ expando ] ) {
return fn( argument );
}
// But maintain support for old signatures
if ( fn.length > 1 ) {
args = [ pseudo, pseudo, "", argument ];
return Expr.setFilters.hasOwnProperty( pseudo.toLowerCase() ) ?
markFunction( function( seed, matches ) {
var idx,
matched = fn( seed, argument ),
i = matched.length;
while ( i-- ) {
idx = indexOf( seed, matched[ i ] );
seed[ idx ] = !( matches[ idx ] = matched[ i ] );
}
} ) :
function( elem ) {
return fn( elem, 0, args );
};
}
return fn;
}
},
pseudos: {
// Potentially complex pseudos
"not": markFunction( function( selector ) {
// Trim the selector passed to compile
// to avoid treating leading and trailing
// spaces as combinators
var input = [],
results = [],
matcher = compile( selector.replace( rtrim, "$1" ) );
return matcher[ expando ] ?
markFunction( function( seed, matches, _context, xml ) {
var elem,
unmatched = matcher( seed, null, xml, [] ),
i = seed.length;
// Match elements unmatched by `matcher`
while ( i-- ) {
if ( ( elem = unmatched[ i ] ) ) {
seed[ i ] = !( matches[ i ] = elem );
}
}
} ) :
function( elem, _context, xml ) {
input[ 0 ] = elem;
matcher( input, null, xml, results );
// Don't keep the element (issue #299)
input[ 0 ] = null;
return !results.pop();
};
} ),
"has": markFunction( function( selector ) {
return function( elem ) {
return Sizzle( selector, elem ).length > 0;
};
} ),
"contains": markFunction( function( text ) {
text = text.replace( runescape, funescape );
return function( elem ) {
return ( elem.textContent || getText( elem ) ).indexOf( text ) > -1;
};
} ),
// "Whether an element is represented by a :lang() selector
// is based solely on the element's language value
// being equal to the identifier C,
// or beginning with the identifier C immediately followed by "-".
// The matching of C against the element's language value is performed case-insensitively.
// The identifier C does not have to be a valid language name."
// http://www.w3.org/TR/selectors/#lang-pseudo
"lang": markFunction( function( lang ) {
// lang value must be a valid identifier
if ( !ridentifier.test( lang || "" ) ) {
Sizzle.error( "unsupported lang: " + lang );
}
lang = lang.replace( runescape, funescape ).toLowerCase();
return function( elem ) {
var elemLang;
do {
if ( ( elemLang = documentIsHTML ?
elem.lang :
elem.getAttribute( "xml:lang" ) || elem.getAttribute( "lang" ) ) ) {
elemLang = elemLang.toLowerCase();
return elemLang === lang || elemLang.indexOf( lang + "-" ) === 0;
}
} while ( ( elem = elem.parentNode ) && elem.nodeType === 1 );
return false;
};
} ),
// Miscellaneous
"target": function( elem ) {
var hash = window.location && window.location.hash;
return hash && hash.slice( 1 ) === elem.id;
},
"root": function( elem ) {
return elem === docElem;
},
"focus": function( elem ) {
return elem === document.activeElement &&
( !document.hasFocus || document.hasFocus() ) &&
!!( elem.type || elem.href || ~elem.tabIndex );
},
// Boolean properties
"enabled": createDisabledPseudo( false ),
"disabled": createDisabledPseudo( true ),
"checked": function( elem ) {
// In CSS3, :checked should return both checked and selected elements
// http://www.w3.org/TR/2011/REC-css3-selectors-20110929/#checked
var nodeName = elem.nodeName.toLowerCase();
return ( nodeName === "input" && !!elem.checked ) ||
( nodeName === "option" && !!elem.selected );
},
"selected": function( elem ) {
// Accessing this property makes selected-by-default
// options in Safari work properly
if ( elem.parentNode ) {
// eslint-disable-next-line no-unused-expressions
elem.parentNode.selectedIndex;
}
return elem.selected === true;
},
// Contents
"empty": function( elem ) {
// http://www.w3.org/TR/selectors/#empty-pseudo
// :empty is negated by element (1) or content nodes (text: 3; cdata: 4; entity ref: 5),
// but not by others (comment: 8; processing instruction: 7; etc.)
// nodeType < 6 works because attributes (2) do not appear as children
for ( elem = elem.firstChild; elem; elem = elem.nextSibling ) {
if ( elem.nodeType < 6 ) {
return false;
}
}
return true;
},
"parent": function( elem ) {
return !Expr.pseudos[ "empty" ]( elem );
},
// Element/input types
"header": function( elem ) {
return rheader.test( elem.nodeName );
},
"input": function( elem ) {
return rinputs.test( elem.nodeName );
},
"button": function( elem ) {
var name = elem.nodeName.toLowerCase();
return name === "input" && elem.type === "button" || name === "button";
},
"text": function( elem ) {
var attr;
return elem.nodeName.toLowerCase() === "input" &&
elem.type === "text" &&
// Support: IE<8
// New HTML5 attribute values (e.g., "search") appear with elem.type === "text"
( ( attr = elem.getAttribute( "type" ) ) == null ||
attr.toLowerCase() === "text" );
},
// Position-in-collection
"first": createPositionalPseudo( function() {
return [ 0 ];
} ),
"last": createPositionalPseudo( function( _matchIndexes, length ) {
return [ length - 1 ];
} ),
"eq": createPositionalPseudo( function( _matchIndexes, length, argument ) {
return [ argument < 0 ? argument + length : argument ];
} ),
"even": createPositionalPseudo( function( matchIndexes, length ) {
var i = 0;
for ( ; i < length; i += 2 ) {
matchIndexes.push( i );
}
return matchIndexes;
} ),
"odd": createPositionalPseudo( function( matchIndexes, length ) {
var i = 1;
for ( ; i < length; i += 2 ) {
matchIndexes.push( i );
}
return matchIndexes;
} ),
"lt": createPositionalPseudo( function( matchIndexes, length, argument ) {
var i = argument < 0 ?
argument + length :
argument > length ?
length :
argument;
for ( ; --i >= 0; ) {
matchIndexes.push( i );
}
return matchIndexes;
} ),
"gt": createPositionalPseudo( function( matchIndexes, length, argument ) {
var i = argument < 0 ? argument + length : argument;
for ( ; ++i < length; ) {
matchIndexes.push( i );
}
return matchIndexes;
} )
}
};
Expr.pseudos[ "nth" ] = Expr.pseudos[ "eq" ];
// Add button/input type pseudos
for ( i in { radio: true, checkbox: true, file: true, password: true, image: true } ) {
Expr.pseudos[ i ] = createInputPseudo( i );
}
for ( i in { submit: true, reset: true } ) {
Expr.pseudos[ i ] = createButtonPseudo( i );
}
// Easy API for creating new setFilters
function setFilters() {}
setFilters.prototype = Expr.filters = Expr.pseudos;
Expr.setFilters = new setFilters();
tokenize = Sizzle.tokenize = function( selector, parseOnly ) {
var matched, match, tokens, type,
soFar, groups, preFilters,
cached = tokenCache[ selector + " " ];
if ( cached ) {
return parseOnly ? 0 : cached.slice( 0 );
}
soFar = selector;
groups = [];
preFilters = Expr.preFilter;
while ( soFar ) {
// Comma and first run
if ( !matched || ( match = rcomma.exec( soFar ) ) ) {
if ( match ) {
// Don't consume trailing commas as valid
soFar = soFar.slice( match[ 0 ].length ) || soFar;
}
groups.push( ( tokens = [] ) );
}
matched = false;
// Combinators
if ( ( match = rcombinators.exec( soFar ) ) ) {
matched = match.shift();
tokens.push( {
value: matched,
// Cast descendant combinators to space
type: match[ 0 ].replace( rtrim, " " )
} );
soFar = soFar.slice( matched.length );
}
// Filters
for ( type in Expr.filter ) {
if ( ( match = matchExpr[ type ].exec( soFar ) ) && ( !preFilters[ type ] ||
( match = preFilters[ type ]( match ) ) ) ) {
matched = match.shift();
tokens.push( {
value: matched,
type: type,
matches: match
} );
soFar = soFar.slice( matched.length );
}
}
if ( !matched ) {
break;
}
}
// Return the length of the invalid excess
// if we're just parsing
// Otherwise, throw an error or return tokens
return parseOnly ?
soFar.length :
soFar ?
Sizzle.error( selector ) :
// Cache the tokens
tokenCache( selector, groups ).slice( 0 );
};
function toSelector( tokens ) {
var i = 0,
len = tokens.length,
selector = "";
for ( ; i < len; i++ ) {
selector += tokens[ i ].value;
}
return selector;
}
function addCombinator( matcher, combinator, base ) {
var dir = combinator.dir,
skip = combinator.next,
key = skip || dir,
checkNonElements = base && key === "parentNode",
doneName = done++;
return combinator.first ?
// Check against closest ancestor/preceding element
function( elem, context, xml ) {
while ( ( elem = elem[ dir ] ) ) {
if ( elem.nodeType === 1 || checkNonElements ) {
return matcher( elem, context, xml );
}
}
return false;
} :
// Check against all ancestor/preceding elements
function( elem, context, xml ) {
var oldCache, uniqueCache, outerCache,
newCache = [ dirruns, doneName ];
// We can't set arbitrary data on XML nodes, so they don't benefit from combinator caching
if ( xml ) {
while ( ( elem = elem[ dir ] ) ) {
if ( elem.nodeType === 1 || checkNonElements ) {
if ( matcher( elem, context, xml ) ) {
return true;
}
}
}
} else {
while ( ( elem = elem[ dir ] ) ) {
if ( elem.nodeType === 1 || checkNonElements ) {
outerCache = elem[ expando ] || ( elem[ expando ] = {} );
// Support: IE <9 only
// Defend against cloned attroperties (jQuery gh-1709)
uniqueCache = outerCache[ elem.uniqueID ] ||
( outerCache[ elem.uniqueID ] = {} );
if ( skip && skip === elem.nodeName.toLowerCase() ) {
elem = elem[ dir ] || elem;
} else if ( ( oldCache = uniqueCache[ key ] ) &&
oldCache[ 0 ] === dirruns && oldCache[ 1 ] === doneName ) {
// Assign to newCache so results back-propagate to previous elements
return ( newCache[ 2 ] = oldCache[ 2 ] );
} else {
// Reuse newcache so results back-propagate to previous elements
uniqueCache[ key ] = newCache;
// A match means we're done; a fail means we have to keep checking
if ( ( newCache[ 2 ] = matcher( elem, context, xml ) ) ) {
return true;
}
}
}
}
}
return false;
};
}
function elementMatcher( matchers ) {
return matchers.length > 1 ?
function( elem, context, xml ) {
var i = matchers.length;
while ( i-- ) {
if ( !matchers[ i ]( elem, context, xml ) ) {
return false;
}
}
return true;
} :
matchers[ 0 ];
}
function multipleContexts( selector, contexts, results ) {
var i = 0,
len = contexts.length;
for ( ; i < len; i++ ) {
Sizzle( selector, contexts[ i ], results );
}
return results;
}
function condense( unmatched, map, filter, context, xml ) {
var elem,
newUnmatched = [],
i = 0,
len = unmatched.length,
mapped = map != null;
for ( ; i < len; i++ ) {
if ( ( elem = unmatched[ i ] ) ) {
if ( !filter || filter( elem, context, xml ) ) {
newUnmatched.push( elem );
if ( mapped ) {
map.push( i );
}
}
}
}
return newUnmatched;
}
function setMatcher( preFilter, selector, matcher, postFilter, postFinder, postSelector ) {
if ( postFilter && !postFilter[ expando ] ) {
postFilter = setMatcher( postFilter );
}
if ( postFinder && !postFinder[ expando ] ) {
postFinder = setMatcher( postFinder, postSelector );
}
return markFunction( function( seed, results, context, xml ) {
var temp, i, elem,
preMap = [],
postMap = [],
preexisting = results.length,
// Get initial elements from seed or context
elems = seed || multipleContexts(
selector || "*",
context.nodeType ? [ context ] : context,
[]
),
// Prefilter to get matcher input, preserving a map for seed-results synchronization
matcherIn = preFilter && ( seed || !selector ) ?
condense( elems, preMap, preFilter, context, xml ) :
elems,
matcherOut = matcher ?
// If we have a postFinder, or filtered seed, or non-seed postFilter or preexisting results,
postFinder || ( seed ? preFilter : preexisting || postFilter ) ?
// ...intermediate processing is necessary
[] :
// ...otherwise use results directly
results :
matcherIn;
// Find primary matches
if ( matcher ) {
matcher( matcherIn, matcherOut, context, xml );
}
// Apply postFilter
if ( postFilter ) {
temp = condense( matcherOut, postMap );
postFilter( temp, [], context, xml );
// Un-match failing elements by moving them back to matcherIn
i = temp.length;
while ( i-- ) {
if ( ( elem = temp[ i ] ) ) {
matcherOut[ postMap[ i ] ] = !( matcherIn[ postMap[ i ] ] = elem );
}
}
}
if ( seed ) {
if ( postFinder || preFilter ) {
if ( postFinder ) {
// Get the final matcherOut by condensing this intermediate into postFinder contexts
temp = [];
i = matcherOut.length;
while ( i-- ) {
if ( ( elem = matcherOut[ i ] ) ) {
// Restore matcherIn since elem is not yet a final match
temp.push( ( matcherIn[ i ] = elem ) );
}
}
postFinder( null, ( matcherOut = [] ), temp, xml );
}
// Move matched elements from seed to results to keep them synchronized
i = matcherOut.length;
while ( i-- ) {
if ( ( elem = matcherOut[ i ] ) &&
( temp = postFinder ? indexOf( seed, elem ) : preMap[ i ] ) > -1 ) {
seed[ temp ] = !( results[ temp ] = elem );
}
}
}
// Add elements to results, through postFinder if defined
} else {
matcherOut = condense(
matcherOut === results ?
matcherOut.splice( preexisting, matcherOut.length ) :
matcherOut
);
if ( postFinder ) {
postFinder( null, results, matcherOut, xml );
} else {
push.apply( results, matcherOut );
}
}
} );
}
function matcherFromTokens( tokens ) {
var checkContext, matcher, j,
len = tokens.length,
leadingRelative = Expr.relative[ tokens[ 0 ].type ],
implicitRelative = leadingRelative || Expr.relative[ " " ],
i = leadingRelative ? 1 : 0,
// The foundational matcher ensures that elements are reachable from top-level context(s)
matchContext = addCombinator( function( elem ) {
return elem === checkContext;
}, implicitRelative, true ),
matchAnyContext = addCombinator( function( elem ) {
return indexOf( checkContext, elem ) > -1;
}, implicitRelative, true ),
matchers = [ function( elem, context, xml ) {
var ret = ( !leadingRelative && ( xml || context !== outermostContext ) ) || (
( checkContext = context ).nodeType ?
matchContext( elem, context, xml ) :
matchAnyContext( elem, context, xml ) );
// Avoid hanging onto element (issue #299)
checkContext = null;
return ret;
} ];
for ( ; i < len; i++ ) {
if ( ( matcher = Expr.relative[ tokens[ i ].type ] ) ) {
matchers = [ addCombinator( elementMatcher( matchers ), matcher ) ];
} else {
matcher = Expr.filter[ tokens[ i ].type ].apply( null, tokens[ i ].matches );
// Return special upon seeing a positional matcher
if ( matcher[ expando ] ) {
// Find the next relative operator (if any) for proper handling
j = ++i;
for ( ; j < len; j++ ) {
if ( Expr.relative[ tokens[ j ].type ] ) {
break;
}
}
return setMatcher(
i > 1 && elementMatcher( matchers ),
i > 1 && toSelector(
// If the preceding token was a descendant combinator, insert an implicit any-element `*`
tokens
.slice( 0, i - 1 )
.concat( { value: tokens[ i - 2 ].type === " " ? "*" : "" } )
).replace( rtrim, "$1" ),
matcher,
i < j && matcherFromTokens( tokens.slice( i, j ) ),
j < len && matcherFromTokens( ( tokens = tokens.slice( j ) ) ),
j < len && toSelector( tokens )
);
}
matchers.push( matcher );
}
}
return elementMatcher( matchers );
}
function matcherFromGroupMatchers( elementMatchers, setMatchers ) {
var bySet = setMatchers.length > 0,
byElement = elementMatchers.length > 0,
superMatcher = function( seed, context, xml, results, outermost ) {
var elem, j, matcher,
matchedCount = 0,
i = "0",
unmatched = seed && [],
setMatched = [],
contextBackup = outermostContext,
// We must always have either seed elements or outermost context
elems = seed || byElement && Expr.find[ "TAG" ]( "*", outermost ),
// Use integer dirruns iff this is the outermost matcher
dirrunsUnique = ( dirruns += contextBackup == null ? 1 : Math.random() || 0.1 ),
len = elems.length;
if ( outermost ) {
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
outermostContext = context == document || context || outermost;
}
// Add elements passing elementMatchers directly to results
// Support: IE<9, Safari
// Tolerate NodeList properties (IE: "length"; Safari: ) matching elements by id
for ( ; i !== len && ( elem = elems[ i ] ) != null; i++ ) {
if ( byElement && elem ) {
j = 0;
// Support: IE 11+, Edge 17 - 18+
// IE/Edge sometimes throw a "Permission denied" error when strict-comparing
// two documents; shallow comparisons work.
// eslint-disable-next-line eqeqeq
if ( !context && elem.ownerDocument != document ) {
setDocument( elem );
xml = !documentIsHTML;
}
while ( ( matcher = elementMatchers[ j++ ] ) ) {
if ( matcher( elem, context || document, xml ) ) {
results.push( elem );
break;
}
}
if ( outermost ) {
dirruns = dirrunsUnique;
}
}
// Track unmatched elements for set filters
if ( bySet ) {
// They will have gone through all possible matchers
if ( ( elem = !matcher && elem ) ) {
matchedCount--;
}
// Lengthen the array for every element, matched or not
if ( seed ) {
unmatched.push( elem );
}
}
}
// `i` is now the count of elements visited above, and adding it to `matchedCount`
// makes the latter nonnegative.
matchedCount += i;
// Apply set filters to unmatched elements
// NOTE: This can be skipped if there are no unmatched elements (i.e., `matchedCount`
// equals `i`), unless we didn't visit _any_ elements in the above loop because we have
// no element matchers and no seed.
// Incrementing an initially-string "0" `i` allows `i` to remain a string only in that
// case, which will result in a "00" `matchedCount` that differs from `i` but is also
// numerically zero.
if ( bySet && i !== matchedCount ) {
j = 0;
while ( ( matcher = setMatchers[ j++ ] ) ) {
matcher( unmatched, setMatched, context, xml );
}
if ( seed ) {
// Reintegrate element matches to eliminate the need for sorting
if ( matchedCount > 0 ) {
while ( i-- ) {
if ( !( unmatched[ i ] || setMatched[ i ] ) ) {
setMatched[ i ] = pop.call( results );
}
}
}
// Discard index placeholder values to get only actual matches
setMatched = condense( setMatched );
}
// Add matches to results
push.apply( results, setMatched );
// Seedless set matches succeeding multiple successful matchers stipulate sorting
if ( outermost && !seed && setMatched.length > 0 &&
( matchedCount + setMatchers.length ) > 1 ) {
Sizzle.uniqueSort( results );
}
}
// Override manipulation of globals by nested matchers
if ( outermost ) {
dirruns = dirrunsUnique;
outermostContext = contextBackup;
}
return unmatched;
};
return bySet ?
markFunction( superMatcher ) :
superMatcher;
}
compile = Sizzle.compile = function( selector, match /* Internal Use Only */ ) {
var i,
setMatchers = [],
elementMatchers = [],
cached = compilerCache[ selector + " " ];
if ( !cached ) {
// Generate a function of recursive functions that can be used to check each element
if ( !match ) {
match = tokenize( selector );
}
i = match.length;
while ( i-- ) {
cached = matcherFromTokens( match[ i ] );
if ( cached[ expando ] ) {
setMatchers.push( cached );
} else {
elementMatchers.push( cached );
}
}
// Cache the compiled function
cached = compilerCache(
selector,
matcherFromGroupMatchers( elementMatchers, setMatchers )
);
// Save selector and tokenization
cached.selector = selector;
}
return cached;
};
/**
* A low-level selection function that works with Sizzle's compiled
* selector functions
* @param {String|Function} selector A selector or a pre-compiled
* selector function built with Sizzle.compile
* @param {Element} context
* @param {Array} [results]
* @param {Array} [seed] A set of elements to match against
*/
select = Sizzle.select = function( selector, context, results, seed ) {
var i, tokens, token, type, find,
compiled = typeof selector === "function" && selector,
match = !seed && tokenize( ( selector = compiled.selector || selector ) );
results = results || [];
// Try to minimize operations if there is only one selector in the list and no seed
// (the latter of which guarantees us context)
if ( match.length === 1 ) {
// Reduce context if the leading compound selector is an ID
tokens = match[ 0 ] = match[ 0 ].slice( 0 );
if ( tokens.length > 2 && ( token = tokens[ 0 ] ).type === "ID" &&
context.nodeType === 9 && documentIsHTML && Expr.relative[ tokens[ 1 ].type ] ) {
context = ( Expr.find[ "ID" ]( token.matches[ 0 ]
.replace( runescape, funescape ), context ) || [] )[ 0 ];
if ( !context ) {
return results;
// Precompiled matchers will still verify ancestry, so step up a level
} else if ( compiled ) {
context = context.parentNode;
}
selector = selector.slice( tokens.shift().value.length );
}
// Fetch a seed set for right-to-left matching
i = matchExpr[ "needsContext" ].test( selector ) ? 0 : tokens.length;
while ( i-- ) {
token = tokens[ i ];
// Abort if we hit a combinator
if ( Expr.relative[ ( type = token.type ) ] ) {
break;
}
if ( ( find = Expr.find[ type ] ) ) {
// Search, expanding context for leading sibling combinators
if ( ( seed = find(
token.matches[ 0 ].replace( runescape, funescape ),
rsibling.test( tokens[ 0 ].type ) && testContext( context.parentNode ) ||
context
) ) ) {
// If seed is empty or no tokens remain, we can return early
tokens.splice( i, 1 );
selector = seed.length && toSelector( tokens );
if ( !selector ) {
push.apply( results, seed );
return results;
}
break;
}
}
}
}
// Compile and execute a filtering function if one is not provided
// Provide `match` to avoid retokenization if we modified the selector above
( compiled || compile( selector, match ) )(
seed,
context,
!documentIsHTML,
results,
!context || rsibling.test( selector ) && testContext( context.parentNode ) || context
);
return results;
};
// One-time assignments
// Sort stability
support.sortStable = expando.split( "" ).sort( sortOrder ).join( "" ) === expando;
// Support: Chrome 14-35+
// Always assume duplicates if they aren't passed to the comparison function
support.detectDuplicates = !!hasDuplicate;
// Initialize against the default document
setDocument();
// Support: Webkit<537.32 - Safari 6.0.3/Chrome 25 (fixed in Chrome 27)
// Detached nodes confoundingly follow *each other*
support.sortDetached = assert( function( el ) {
// Should return 1, but returns 4 (following)
return el.compareDocumentPosition( document.createElement( "fieldset" ) ) & 1;
} );
// Support: IE<8
// Prevent attribute/property "interpolation"
// https://msdn.microsoft.com/en-us/library/ms536429%28VS.85%29.aspx
if ( !assert( function( el ) {
el.innerHTML = " ";
return el.firstChild.getAttribute( "href" ) === "#";
} ) ) {
addHandle( "type|href|height|width", function( elem, name, isXML ) {
if ( !isXML ) {
return elem.getAttribute( name, name.toLowerCase() === "type" ? 1 : 2 );
}
} );
}
// Support: IE<9
// Use defaultValue in place of getAttribute("value")
if ( !support.attributes || !assert( function( el ) {
el.innerHTML = " ";
el.firstChild.setAttribute( "value", "" );
return el.firstChild.getAttribute( "value" ) === "";
} ) ) {
addHandle( "value", function( elem, _name, isXML ) {
if ( !isXML && elem.nodeName.toLowerCase() === "input" ) {
return elem.defaultValue;
}
} );
}
// Support: IE<9
// Use getAttributeNode to fetch booleans when getAttribute lies
if ( !assert( function( el ) {
return el.getAttribute( "disabled" ) == null;
} ) ) {
addHandle( booleans, function( elem, name, isXML ) {
var val;
if ( !isXML ) {
return elem[ name ] === true ? name.toLowerCase() :
( val = elem.getAttributeNode( name ) ) && val.specified ?
val.value :
null;
}
} );
}
return Sizzle;
} )( window );
jQuery.find = Sizzle;
jQuery.expr = Sizzle.selectors;
// Deprecated
jQuery.expr[ ":" ] = jQuery.expr.pseudos;
jQuery.uniqueSort = jQuery.unique = Sizzle.uniqueSort;
jQuery.text = Sizzle.getText;
jQuery.isXMLDoc = Sizzle.isXML;
jQuery.contains = Sizzle.contains;
jQuery.escapeSelector = Sizzle.escape;
var dir = function( elem, dir, until ) {
var matched = [],
truncate = until !== undefined;
while ( ( elem = elem[ dir ] ) && elem.nodeType !== 9 ) {
if ( elem.nodeType === 1 ) {
if ( truncate && jQuery( elem ).is( until ) ) {
break;
}
matched.push( elem );
}
}
return matched;
};
var siblings = function( n, elem ) {
var matched = [];
for ( ; n; n = n.nextSibling ) {
if ( n.nodeType === 1 && n !== elem ) {
matched.push( n );
}
}
return matched;
};
var rneedsContext = jQuery.expr.match.needsContext;
function nodeName( elem, name ) {
return elem.nodeName && elem.nodeName.toLowerCase() === name.toLowerCase();
}
var rsingleTag = ( /^<([a-z][^\/\0>:\x20\t\r\n\f]*)[\x20\t\r\n\f]*\/?>(?:<\/\1>|)$/i );
// Implement the identical functionality for filter and not
function winnow( elements, qualifier, not ) {
if ( isFunction( qualifier ) ) {
return jQuery.grep( elements, function( elem, i ) {
return !!qualifier.call( elem, i, elem ) !== not;
} );
}
// Single element
if ( qualifier.nodeType ) {
return jQuery.grep( elements, function( elem ) {
return ( elem === qualifier ) !== not;
} );
}
// Arraylike of elements (jQuery, arguments, Array)
if ( typeof qualifier !== "string" ) {
return jQuery.grep( elements, function( elem ) {
return ( indexOf.call( qualifier, elem ) > -1 ) !== not;
} );
}
// Filtered directly for both simple and complex selectors
return jQuery.filter( qualifier, elements, not );
}
jQuery.filter = function( expr, elems, not ) {
var elem = elems[ 0 ];
if ( not ) {
expr = ":not(" + expr + ")";
}
if ( elems.length === 1 && elem.nodeType === 1 ) {
return jQuery.find.matchesSelector( elem, expr ) ? [ elem ] : [];
}
return jQuery.find.matches( expr, jQuery.grep( elems, function( elem ) {
return elem.nodeType === 1;
} ) );
};
jQuery.fn.extend( {
find: function( selector ) {
var i, ret,
len = this.length,
self = this;
if ( typeof selector !== "string" ) {
return this.pushStack( jQuery( selector ).filter( function() {
for ( i = 0; i < len; i++ ) {
if ( jQuery.contains( self[ i ], this ) ) {
return true;
}
}
} ) );
}
ret = this.pushStack( [] );
for ( i = 0; i < len; i++ ) {
jQuery.find( selector, self[ i ], ret );
}
return len > 1 ? jQuery.uniqueSort( ret ) : ret;
},
filter: function( selector ) {
return this.pushStack( winnow( this, selector || [], false ) );
},
not: function( selector ) {
return this.pushStack( winnow( this, selector || [], true ) );
},
is: function( selector ) {
return !!winnow(
this,
// If this is a positional/relative selector, check membership in the returned set
// so $("p:first").is("p:last") won't return true for a doc with two "p".
typeof selector === "string" && rneedsContext.test( selector ) ?
jQuery( selector ) :
selector || [],
false
).length;
}
} );
// Initialize a jQuery object
// A central reference to the root jQuery(document)
var rootjQuery,
// A simple way to check for HTML strings
// Prioritize #id over to avoid XSS via location.hash (#9521)
// Strict HTML recognition (#11290: must start with <)
// Shortcut simple #id case for speed
rquickExpr = /^(?:\s*(<[\w\W]+>)[^>]*|#([\w-]+))$/,
init = jQuery.fn.init = function( selector, context, root ) {
var match, elem;
// HANDLE: $(""), $(null), $(undefined), $(false)
if ( !selector ) {
return this;
}
// Method init() accepts an alternate rootjQuery
// so migrate can support jQuery.sub (gh-2101)
root = root || rootjQuery;
// Handle HTML strings
if ( typeof selector === "string" ) {
if ( selector[ 0 ] === "<" &&
selector[ selector.length - 1 ] === ">" &&
selector.length >= 3 ) {
// Assume that strings that start and end with <> are HTML and skip the regex check
match = [ null, selector, null ];
} else {
match = rquickExpr.exec( selector );
}
// Match html or make sure no context is specified for #id
if ( match && ( match[ 1 ] || !context ) ) {
// HANDLE: $(html) -> $(array)
if ( match[ 1 ] ) {
context = context instanceof jQuery ? context[ 0 ] : context;
// Option to run scripts is true for back-compat
// Intentionally let the error be thrown if parseHTML is not present
jQuery.merge( this, jQuery.parseHTML(
match[ 1 ],
context && context.nodeType ? context.ownerDocument || context : document,
true
) );
// HANDLE: $(html, props)
if ( rsingleTag.test( match[ 1 ] ) && jQuery.isPlainObject( context ) ) {
for ( match in context ) {
// Properties of context are called as methods if possible
if ( isFunction( this[ match ] ) ) {
this[ match ]( context[ match ] );
// ...and otherwise set as attributes
} else {
this.attr( match, context[ match ] );
}
}
}
return this;
// HANDLE: $(#id)
} else {
elem = document.getElementById( match[ 2 ] );
if ( elem ) {
// Inject the element directly into the jQuery object
this[ 0 ] = elem;
this.length = 1;
}
return this;
}
// HANDLE: $(expr, $(...))
} else if ( !context || context.jquery ) {
return ( context || root ).find( selector );
// HANDLE: $(expr, context)
// (which is just equivalent to: $(context).find(expr)
} else {
return this.constructor( context ).find( selector );
}
// HANDLE: $(DOMElement)
} else if ( selector.nodeType ) {
this[ 0 ] = selector;
this.length = 1;
return this;
// HANDLE: $(function)
// Shortcut for document ready
} else if ( isFunction( selector ) ) {
return root.ready !== undefined ?
root.ready( selector ) :
// Execute immediately if ready is not present
selector( jQuery );
}
return jQuery.makeArray( selector, this );
};
// Give the init function the jQuery prototype for later instantiation
init.prototype = jQuery.fn;
// Initialize central reference
rootjQuery = jQuery( document );
var rparentsprev = /^(?:parents|prev(?:Until|All))/,
// Methods guaranteed to produce a unique set when starting from a unique set
guaranteedUnique = {
children: true,
contents: true,
next: true,
prev: true
};
jQuery.fn.extend( {
has: function( target ) {
var targets = jQuery( target, this ),
l = targets.length;
return this.filter( function() {
var i = 0;
for ( ; i < l; i++ ) {
if ( jQuery.contains( this, targets[ i ] ) ) {
return true;
}
}
} );
},
closest: function( selectors, context ) {
var cur,
i = 0,
l = this.length,
matched = [],
targets = typeof selectors !== "string" && jQuery( selectors );
// Positional selectors never match, since there's no _selection_ context
if ( !rneedsContext.test( selectors ) ) {
for ( ; i < l; i++ ) {
for ( cur = this[ i ]; cur && cur !== context; cur = cur.parentNode ) {
// Always skip document fragments
if ( cur.nodeType < 11 && ( targets ?
targets.index( cur ) > -1 :
// Don't pass non-elements to Sizzle
cur.nodeType === 1 &&
jQuery.find.matchesSelector( cur, selectors ) ) ) {
matched.push( cur );
break;
}
}
}
}
return this.pushStack( matched.length > 1 ? jQuery.uniqueSort( matched ) : matched );
},
// Determine the position of an element within the set
index: function( elem ) {
// No argument, return index in parent
if ( !elem ) {
return ( this[ 0 ] && this[ 0 ].parentNode ) ? this.first().prevAll().length : -1;
}
// Index in selector
if ( typeof elem === "string" ) {
return indexOf.call( jQuery( elem ), this[ 0 ] );
}
// Locate the position of the desired element
return indexOf.call( this,
// If it receives a jQuery object, the first element is used
elem.jquery ? elem[ 0 ] : elem
);
},
add: function( selector, context ) {
return this.pushStack(
jQuery.uniqueSort(
jQuery.merge( this.get(), jQuery( selector, context ) )
)
);
},
addBack: function( selector ) {
return this.add( selector == null ?
this.prevObject : this.prevObject.filter( selector )
);
}
} );
function sibling( cur, dir ) {
while ( ( cur = cur[ dir ] ) && cur.nodeType !== 1 ) {}
return cur;
}
jQuery.each( {
parent: function( elem ) {
var parent = elem.parentNode;
return parent && parent.nodeType !== 11 ? parent : null;
},
parents: function( elem ) {
return dir( elem, "parentNode" );
},
parentsUntil: function( elem, _i, until ) {
return dir( elem, "parentNode", until );
},
next: function( elem ) {
return sibling( elem, "nextSibling" );
},
prev: function( elem ) {
return sibling( elem, "previousSibling" );
},
nextAll: function( elem ) {
return dir( elem, "nextSibling" );
},
prevAll: function( elem ) {
return dir( elem, "previousSibling" );
},
nextUntil: function( elem, _i, until ) {
return dir( elem, "nextSibling", until );
},
prevUntil: function( elem, _i, until ) {
return dir( elem, "previousSibling", until );
},
siblings: function( elem ) {
return siblings( ( elem.parentNode || {} ).firstChild, elem );
},
children: function( elem ) {
return siblings( elem.firstChild );
},
contents: function( elem ) {
if ( elem.contentDocument != null &&
// Support: IE 11+
// elements with no `data` attribute has an object
// `contentDocument` with a `null` prototype.
getProto( elem.contentDocument ) ) {
return elem.contentDocument;
}
// Support: IE 9 - 11 only, iOS 7 only, Android Browser <=4.3 only
// Treat the template element as a regular one in browsers that
// don't support it.
if ( nodeName( elem, "template" ) ) {
elem = elem.content || elem;
}
return jQuery.merge( [], elem.childNodes );
}
}, function( name, fn ) {
jQuery.fn[ name ] = function( until, selector ) {
var matched = jQuery.map( this, fn, until );
if ( name.slice( -5 ) !== "Until" ) {
selector = until;
}
if ( selector && typeof selector === "string" ) {
matched = jQuery.filter( selector, matched );
}
if ( this.length > 1 ) {
// Remove duplicates
if ( !guaranteedUnique[ name ] ) {
jQuery.uniqueSort( matched );
}
// Reverse order for parents* and prev-derivatives
if ( rparentsprev.test( name ) ) {
matched.reverse();
}
}
return this.pushStack( matched );
};
} );
var rnothtmlwhite = ( /[^\x20\t\r\n\f]+/g );
// Convert String-formatted options into Object-formatted ones
function createOptions( options ) {
var object = {};
jQuery.each( options.match( rnothtmlwhite ) || [], function( _, flag ) {
object[ flag ] = true;
} );
return object;
}
/*
* Create a callback list using the following parameters:
*
* options: an optional list of space-separated options that will change how
* the callback list behaves or a more traditional option object
*
* By default a callback list will act like an event callback list and can be
* "fired" multiple times.
*
* Possible options:
*
* once: will ensure the callback list can only be fired once (like a Deferred)
*
* memory: will keep track of previous values and will call any callback added
* after the list has been fired right away with the latest "memorized"
* values (like a Deferred)
*
* unique: will ensure a callback can only be added once (no duplicate in the list)
*
* stopOnFalse: interrupt callings when a callback returns false
*
*/
jQuery.Callbacks = function( options ) {
// Convert options from String-formatted to Object-formatted if needed
// (we check in cache first)
options = typeof options === "string" ?
createOptions( options ) :
jQuery.extend( {}, options );
var // Flag to know if list is currently firing
firing,
// Last fire value for non-forgettable lists
memory,
// Flag to know if list was already fired
fired,
// Flag to prevent firing
locked,
// Actual callback list
list = [],
// Queue of execution data for repeatable lists
queue = [],
// Index of currently firing callback (modified by add/remove as needed)
firingIndex = -1,
// Fire callbacks
fire = function() {
// Enforce single-firing
locked = locked || options.once;
// Execute callbacks for all pending executions,
// respecting firingIndex overrides and runtime changes
fired = firing = true;
for ( ; queue.length; firingIndex = -1 ) {
memory = queue.shift();
while ( ++firingIndex < list.length ) {
// Run callback and check for early termination
if ( list[ firingIndex ].apply( memory[ 0 ], memory[ 1 ] ) === false &&
options.stopOnFalse ) {
// Jump to end and forget the data so .add doesn't re-fire
firingIndex = list.length;
memory = false;
}
}
}
// Forget the data if we're done with it
if ( !options.memory ) {
memory = false;
}
firing = false;
// Clean up if we're done firing for good
if ( locked ) {
// Keep an empty list if we have data for future add calls
if ( memory ) {
list = [];
// Otherwise, this object is spent
} else {
list = "";
}
}
},
// Actual Callbacks object
self = {
// Add a callback or a collection of callbacks to the list
add: function() {
if ( list ) {
// If we have memory from a past run, we should fire after adding
if ( memory && !firing ) {
firingIndex = list.length - 1;
queue.push( memory );
}
( function add( args ) {
jQuery.each( args, function( _, arg ) {
if ( isFunction( arg ) ) {
if ( !options.unique || !self.has( arg ) ) {
list.push( arg );
}
} else if ( arg && arg.length && toType( arg ) !== "string" ) {
// Inspect recursively
add( arg );
}
} );
} )( arguments );
if ( memory && !firing ) {
fire();
}
}
return this;
},
// Remove a callback from the list
remove: function() {
jQuery.each( arguments, function( _, arg ) {
var index;
while ( ( index = jQuery.inArray( arg, list, index ) ) > -1 ) {
list.splice( index, 1 );
// Handle firing indexes
if ( index <= firingIndex ) {
firingIndex--;
}
}
} );
return this;
},
// Check if a given callback is in the list.
// If no argument is given, return whether or not list has callbacks attached.
has: function( fn ) {
return fn ?
jQuery.inArray( fn, list ) > -1 :
list.length > 0;
},
// Remove all callbacks from the list
empty: function() {
if ( list ) {
list = [];
}
return this;
},
// Disable .fire and .add
// Abort any current/pending executions
// Clear all callbacks and values
disable: function() {
locked = queue = [];
list = memory = "";
return this;
},
disabled: function() {
return !list;
},
// Disable .fire
// Also disable .add unless we have memory (since it would have no effect)
// Abort any pending executions
lock: function() {
locked = queue = [];
if ( !memory && !firing ) {
list = memory = "";
}
return this;
},
locked: function() {
return !!locked;
},
// Call all callbacks with the given context and arguments
fireWith: function( context, args ) {
if ( !locked ) {
args = args || [];
args = [ context, args.slice ? args.slice() : args ];
queue.push( args );
if ( !firing ) {
fire();
}
}
return this;
},
// Call all the callbacks with the given arguments
fire: function() {
self.fireWith( this, arguments );
return this;
},
// To know if the callbacks have already been called at least once
fired: function() {
return !!fired;
}
};
return self;
};
function Identity( v ) {
return v;
}
function Thrower( ex ) {
throw ex;
}
function adoptValue( value, resolve, reject, noValue ) {
var method;
try {
// Check for promise aspect first to privilege synchronous behavior
if ( value && isFunction( ( method = value.promise ) ) ) {
method.call( value ).done( resolve ).fail( reject );
// Other thenables
} else if ( value && isFunction( ( method = value.then ) ) ) {
method.call( value, resolve, reject );
// Other non-thenables
} else {
// Control `resolve` arguments by letting Array#slice cast boolean `noValue` to integer:
// * false: [ value ].slice( 0 ) => resolve( value )
// * true: [ value ].slice( 1 ) => resolve()
resolve.apply( undefined, [ value ].slice( noValue ) );
}
// For Promises/A+, convert exceptions into rejections
// Since jQuery.when doesn't unwrap thenables, we can skip the extra checks appearing in
// Deferred#then to conditionally suppress rejection.
} catch ( value ) {
// Support: Android 4.0 only
// Strict mode functions invoked without .call/.apply get global-object context
reject.apply( undefined, [ value ] );
}
}
jQuery.extend( {
Deferred: function( func ) {
var tuples = [
// action, add listener, callbacks,
// ... .then handlers, argument index, [final state]
[ "notify", "progress", jQuery.Callbacks( "memory" ),
jQuery.Callbacks( "memory" ), 2 ],
[ "resolve", "done", jQuery.Callbacks( "once memory" ),
jQuery.Callbacks( "once memory" ), 0, "resolved" ],
[ "reject", "fail", jQuery.Callbacks( "once memory" ),
jQuery.Callbacks( "once memory" ), 1, "rejected" ]
],
state = "pending",
promise = {
state: function() {
return state;
},
always: function() {
deferred.done( arguments ).fail( arguments );
return this;
},
"catch": function( fn ) {
return promise.then( null, fn );
},
// Keep pipe for back-compat
pipe: function( /* fnDone, fnFail, fnProgress */ ) {
var fns = arguments;
return jQuery.Deferred( function( newDefer ) {
jQuery.each( tuples, function( _i, tuple ) {
// Map tuples (progress, done, fail) to arguments (done, fail, progress)
var fn = isFunction( fns[ tuple[ 4 ] ] ) && fns[ tuple[ 4 ] ];
// deferred.progress(function() { bind to newDefer or newDefer.notify })
// deferred.done(function() { bind to newDefer or newDefer.resolve })
// deferred.fail(function() { bind to newDefer or newDefer.reject })
deferred[ tuple[ 1 ] ]( function() {
var returned = fn && fn.apply( this, arguments );
if ( returned && isFunction( returned.promise ) ) {
returned.promise()
.progress( newDefer.notify )
.done( newDefer.resolve )
.fail( newDefer.reject );
} else {
newDefer[ tuple[ 0 ] + "With" ](
this,
fn ? [ returned ] : arguments
);
}
} );
} );
fns = null;
} ).promise();
},
then: function( onFulfilled, onRejected, onProgress ) {
var maxDepth = 0;
function resolve( depth, deferred, handler, special ) {
return function() {
var that = this,
args = arguments,
mightThrow = function() {
var returned, then;
// Support: Promises/A+ section 2.3.3.3.3
// https://promisesaplus.com/#point-59
// Ignore double-resolution attempts
if ( depth < maxDepth ) {
return;
}
returned = handler.apply( that, args );
// Support: Promises/A+ section 2.3.1
// https://promisesaplus.com/#point-48
if ( returned === deferred.promise() ) {
throw new TypeError( "Thenable self-resolution" );
}
// Support: Promises/A+ sections 2.3.3.1, 3.5
// https://promisesaplus.com/#point-54
// https://promisesaplus.com/#point-75
// Retrieve `then` only once
then = returned &&
// Support: Promises/A+ section 2.3.4
// https://promisesaplus.com/#point-64
// Only check objects and functions for thenability
( typeof returned === "object" ||
typeof returned === "function" ) &&
returned.then;
// Handle a returned thenable
if ( isFunction( then ) ) {
// Special processors (notify) just wait for resolution
if ( special ) {
then.call(
returned,
resolve( maxDepth, deferred, Identity, special ),
resolve( maxDepth, deferred, Thrower, special )
);
// Normal processors (resolve) also hook into progress
} else {
// ...and disregard older resolution values
maxDepth++;
then.call(
returned,
resolve( maxDepth, deferred, Identity, special ),
resolve( maxDepth, deferred, Thrower, special ),
resolve( maxDepth, deferred, Identity,
deferred.notifyWith )
);
}
// Handle all other returned values
} else {
// Only substitute handlers pass on context
// and multiple values (non-spec behavior)
if ( handler !== Identity ) {
that = undefined;
args = [ returned ];
}
// Process the value(s)
// Default process is resolve
( special || deferred.resolveWith )( that, args );
}
},
// Only normal processors (resolve) catch and reject exceptions
process = special ?
mightThrow :
function() {
try {
mightThrow();
} catch ( e ) {
if ( jQuery.Deferred.exceptionHook ) {
jQuery.Deferred.exceptionHook( e,
process.stackTrace );
}
// Support: Promises/A+ section 2.3.3.3.4.1
// https://promisesaplus.com/#point-61
// Ignore post-resolution exceptions
if ( depth + 1 >= maxDepth ) {
// Only substitute handlers pass on context
// and multiple values (non-spec behavior)
if ( handler !== Thrower ) {
that = undefined;
args = [ e ];
}
deferred.rejectWith( that, args );
}
}
};
// Support: Promises/A+ section 2.3.3.3.1
// https://promisesaplus.com/#point-57
// Re-resolve promises immediately to dodge false rejection from
// subsequent errors
if ( depth ) {
process();
} else {
// Call an optional hook to record the stack, in case of exception
// since it's otherwise lost when execution goes async
if ( jQuery.Deferred.getStackHook ) {
process.stackTrace = jQuery.Deferred.getStackHook();
}
window.setTimeout( process );
}
};
}
return jQuery.Deferred( function( newDefer ) {
// progress_handlers.add( ... )
tuples[ 0 ][ 3 ].add(
resolve(
0,
newDefer,
isFunction( onProgress ) ?
onProgress :
Identity,
newDefer.notifyWith
)
);
// fulfilled_handlers.add( ... )
tuples[ 1 ][ 3 ].add(
resolve(
0,
newDefer,
isFunction( onFulfilled ) ?
onFulfilled :
Identity
)
);
// rejected_handlers.add( ... )
tuples[ 2 ][ 3 ].add(
resolve(
0,
newDefer,
isFunction( onRejected ) ?
onRejected :
Thrower
)
);
} ).promise();
},
// Get a promise for this deferred
// If obj is provided, the promise aspect is added to the object
promise: function( obj ) {
return obj != null ? jQuery.extend( obj, promise ) : promise;
}
},
deferred = {};
// Add list-specific methods
jQuery.each( tuples, function( i, tuple ) {
var list = tuple[ 2 ],
stateString = tuple[ 5 ];
// promise.progress = list.add
// promise.done = list.add
// promise.fail = list.add
promise[ tuple[ 1 ] ] = list.add;
// Handle state
if ( stateString ) {
list.add(
function() {
// state = "resolved" (i.e., fulfilled)
// state = "rejected"
state = stateString;
},
// rejected_callbacks.disable
// fulfilled_callbacks.disable
tuples[ 3 - i ][ 2 ].disable,
// rejected_handlers.disable
// fulfilled_handlers.disable
tuples[ 3 - i ][ 3 ].disable,
// progress_callbacks.lock
tuples[ 0 ][ 2 ].lock,
// progress_handlers.lock
tuples[ 0 ][ 3 ].lock
);
}
// progress_handlers.fire
// fulfilled_handlers.fire
// rejected_handlers.fire
list.add( tuple[ 3 ].fire );
// deferred.notify = function() { deferred.notifyWith(...) }
// deferred.resolve = function() { deferred.resolveWith(...) }
// deferred.reject = function() { deferred.rejectWith(...) }
deferred[ tuple[ 0 ] ] = function() {
deferred[ tuple[ 0 ] + "With" ]( this === deferred ? undefined : this, arguments );
return this;
};
// deferred.notifyWith = list.fireWith
// deferred.resolveWith = list.fireWith
// deferred.rejectWith = list.fireWith
deferred[ tuple[ 0 ] + "With" ] = list.fireWith;
} );
// Make the deferred a promise
promise.promise( deferred );
// Call given func if any
if ( func ) {
func.call( deferred, deferred );
}
// All done!
return deferred;
},
// Deferred helper
when: function( singleValue ) {
var
// count of uncompleted subordinates
remaining = arguments.length,
// count of unprocessed arguments
i = remaining,
// subordinate fulfillment data
resolveContexts = Array( i ),
resolveValues = slice.call( arguments ),
// the primary Deferred
primary = jQuery.Deferred(),
// subordinate callback factory
updateFunc = function( i ) {
return function( value ) {
resolveContexts[ i ] = this;
resolveValues[ i ] = arguments.length > 1 ? slice.call( arguments ) : value;
if ( !( --remaining ) ) {
primary.resolveWith( resolveContexts, resolveValues );
}
};
};
// Single- and empty arguments are adopted like Promise.resolve
if ( remaining <= 1 ) {
adoptValue( singleValue, primary.done( updateFunc( i ) ).resolve, primary.reject,
!remaining );
// Use .then() to unwrap secondary thenables (cf. gh-3000)
if ( primary.state() === "pending" ||
isFunction( resolveValues[ i ] && resolveValues[ i ].then ) ) {
return primary.then();
}
}
// Multiple arguments are aggregated like Promise.all array elements
while ( i-- ) {
adoptValue( resolveValues[ i ], updateFunc( i ), primary.reject );
}
return primary.promise();
}
} );
// These usually indicate a programmer mistake during development,
// warn about them ASAP rather than swallowing them by default.
var rerrorNames = /^(Eval|Internal|Range|Reference|Syntax|Type|URI)Error$/;
jQuery.Deferred.exceptionHook = function( error, stack ) {
// Support: IE 8 - 9 only
// Console exists when dev tools are open, which can happen at any time
if ( window.console && window.console.warn && error && rerrorNames.test( error.name ) ) {
window.console.warn( "jQuery.Deferred exception: " + error.message, error.stack, stack );
}
};
jQuery.readyException = function( error ) {
window.setTimeout( function() {
throw error;
} );
};
// The deferred used on DOM ready
var readyList = jQuery.Deferred();
jQuery.fn.ready = function( fn ) {
readyList
.then( fn )
// Wrap jQuery.readyException in a function so that the lookup
// happens at the time of error handling instead of callback
// registration.
.catch( function( error ) {
jQuery.readyException( error );
} );
return this;
};
jQuery.extend( {
// Is the DOM ready to be used? Set to true once it occurs.
isReady: false,
// A counter to track how many items to wait for before
// the ready event fires. See #6781
readyWait: 1,
// Handle when the DOM is ready
ready: function( wait ) {
// Abort if there are pending holds or we're already ready
if ( wait === true ? --jQuery.readyWait : jQuery.isReady ) {
return;
}
// Remember that the DOM is ready
jQuery.isReady = true;
// If a normal DOM Ready event fired, decrement, and wait if need be
if ( wait !== true && --jQuery.readyWait > 0 ) {
return;
}
// If there are functions bound, to execute
readyList.resolveWith( document, [ jQuery ] );
}
} );
jQuery.ready.then = readyList.then;
// The ready event handler and self cleanup method
function completed() {
document.removeEventListener( "DOMContentLoaded", completed );
window.removeEventListener( "load", completed );
jQuery.ready();
}
// Catch cases where $(document).ready() is called
// after the browser event has already occurred.
// Support: IE <=9 - 10 only
// Older IE sometimes signals "interactive" too soon
if ( document.readyState === "complete" ||
( document.readyState !== "loading" && !document.documentElement.doScroll ) ) {
// Handle it asynchronously to allow scripts the opportunity to delay ready
window.setTimeout( jQuery.ready );
} else {
// Use the handy event callback
document.addEventListener( "DOMContentLoaded", completed );
// A fallback to window.onload, that will always work
window.addEventListener( "load", completed );
}
// Multifunctional method to get and set values of a collection
// The value/s can optionally be executed if it's a function
var access = function( elems, fn, key, value, chainable, emptyGet, raw ) {
var i = 0,
len = elems.length,
bulk = key == null;
// Sets many values
if ( toType( key ) === "object" ) {
chainable = true;
for ( i in key ) {
access( elems, fn, i, key[ i ], true, emptyGet, raw );
}
// Sets one value
} else if ( value !== undefined ) {
chainable = true;
if ( !isFunction( value ) ) {
raw = true;
}
if ( bulk ) {
// Bulk operations run against the entire set
if ( raw ) {
fn.call( elems, value );
fn = null;
// ...except when executing function values
} else {
bulk = fn;
fn = function( elem, _key, value ) {
return bulk.call( jQuery( elem ), value );
};
}
}
if ( fn ) {
for ( ; i < len; i++ ) {
fn(
elems[ i ], key, raw ?
value :
value.call( elems[ i ], i, fn( elems[ i ], key ) )
);
}
}
}
if ( chainable ) {
return elems;
}
// Gets
if ( bulk ) {
return fn.call( elems );
}
return len ? fn( elems[ 0 ], key ) : emptyGet;
};
// Matches dashed string for camelizing
var rmsPrefix = /^-ms-/,
rdashAlpha = /-([a-z])/g;
// Used by camelCase as callback to replace()
function fcamelCase( _all, letter ) {
return letter.toUpperCase();
}
// Convert dashed to camelCase; used by the css and data modules
// Support: IE <=9 - 11, Edge 12 - 15
// Microsoft forgot to hump their vendor prefix (#9572)
function camelCase( string ) {
return string.replace( rmsPrefix, "ms-" ).replace( rdashAlpha, fcamelCase );
}
var acceptData = function( owner ) {
// Accepts only:
// - Node
// - Node.ELEMENT_NODE
// - Node.DOCUMENT_NODE
// - Object
// - Any
return owner.nodeType === 1 || owner.nodeType === 9 || !( +owner.nodeType );
};
function Data() {
this.expando = jQuery.expando + Data.uid++;
}
Data.uid = 1;
Data.prototype = {
cache: function( owner ) {
// Check if the owner object already has a cache
var value = owner[ this.expando ];
// If not, create one
if ( !value ) {
value = {};
// We can accept data for non-element nodes in modern browsers,
// but we should not, see #8335.
// Always return an empty object.
if ( acceptData( owner ) ) {
// If it is a node unlikely to be stringify-ed or looped over
// use plain assignment
if ( owner.nodeType ) {
owner[ this.expando ] = value;
// Otherwise secure it in a non-enumerable property
// configurable must be true to allow the property to be
// deleted when data is removed
} else {
Object.defineProperty( owner, this.expando, {
value: value,
configurable: true
} );
}
}
}
return value;
},
set: function( owner, data, value ) {
var prop,
cache = this.cache( owner );
// Handle: [ owner, key, value ] args
// Always use camelCase key (gh-2257)
if ( typeof data === "string" ) {
cache[ camelCase( data ) ] = value;
// Handle: [ owner, { properties } ] args
} else {
// Copy the properties one-by-one to the cache object
for ( prop in data ) {
cache[ camelCase( prop ) ] = data[ prop ];
}
}
return cache;
},
get: function( owner, key ) {
return key === undefined ?
this.cache( owner ) :
// Always use camelCase key (gh-2257)
owner[ this.expando ] && owner[ this.expando ][ camelCase( key ) ];
},
access: function( owner, key, value ) {
// In cases where either:
//
// 1. No key was specified
// 2. A string key was specified, but no value provided
//
// Take the "read" path and allow the get method to determine
// which value to return, respectively either:
//
// 1. The entire cache object
// 2. The data stored at the key
//
if ( key === undefined ||
( ( key && typeof key === "string" ) && value === undefined ) ) {
return this.get( owner, key );
}
// When the key is not a string, or both a key and value
// are specified, set or extend (existing objects) with either:
//
// 1. An object of properties
// 2. A key and value
//
this.set( owner, key, value );
// Since the "set" path can have two possible entry points
// return the expected data based on which path was taken[*]
return value !== undefined ? value : key;
},
remove: function( owner, key ) {
var i,
cache = owner[ this.expando ];
if ( cache === undefined ) {
return;
}
if ( key !== undefined ) {
// Support array or space separated string of keys
if ( Array.isArray( key ) ) {
// If key is an array of keys...
// We always set camelCase keys, so remove that.
key = key.map( camelCase );
} else {
key = camelCase( key );
// If a key with the spaces exists, use it.
// Otherwise, create an array by matching non-whitespace
key = key in cache ?
[ key ] :
( key.match( rnothtmlwhite ) || [] );
}
i = key.length;
while ( i-- ) {
delete cache[ key[ i ] ];
}
}
// Remove the expando if there's no more data
if ( key === undefined || jQuery.isEmptyObject( cache ) ) {
// Support: Chrome <=35 - 45
// Webkit & Blink performance suffers when deleting properties
// from DOM nodes, so set to undefined instead
// https://bugs.chromium.org/p/chromium/issues/detail?id=378607 (bug restricted)
if ( owner.nodeType ) {
owner[ this.expando ] = undefined;
} else {
delete owner[ this.expando ];
}
}
},
hasData: function( owner ) {
var cache = owner[ this.expando ];
return cache !== undefined && !jQuery.isEmptyObject( cache );
}
};
var dataPriv = new Data();
var dataUser = new Data();
// Implementation Summary
//
// 1. Enforce API surface and semantic compatibility with 1.9.x branch
// 2. Improve the module's maintainability by reducing the storage
// paths to a single mechanism.
// 3. Use the same single mechanism to support "private" and "user" data.
// 4. _Never_ expose "private" data to user code (TODO: Drop _data, _removeData)
// 5. Avoid exposing implementation details on user objects (eg. expando properties)
// 6. Provide a clear path for implementation upgrade to WeakMap in 2014
var rbrace = /^(?:\{[\w\W]*\}|\[[\w\W]*\])$/,
rmultiDash = /[A-Z]/g;
function getData( data ) {
if ( data === "true" ) {
return true;
}
if ( data === "false" ) {
return false;
}
if ( data === "null" ) {
return null;
}
// Only convert to a number if it doesn't change the string
if ( data === +data + "" ) {
return +data;
}
if ( rbrace.test( data ) ) {
return JSON.parse( data );
}
return data;
}
function dataAttr( elem, key, data ) {
var name;
// If nothing was found internally, try to fetch any
// data from the HTML5 data-* attribute
if ( data === undefined && elem.nodeType === 1 ) {
name = "data-" + key.replace( rmultiDash, "-$&" ).toLowerCase();
data = elem.getAttribute( name );
if ( typeof data === "string" ) {
try {
data = getData( data );
} catch ( e ) {}
// Make sure we set the data so it isn't changed later
dataUser.set( elem, key, data );
} else {
data = undefined;
}
}
return data;
}
jQuery.extend( {
hasData: function( elem ) {
return dataUser.hasData( elem ) || dataPriv.hasData( elem );
},
data: function( elem, name, data ) {
return dataUser.access( elem, name, data );
},
removeData: function( elem, name ) {
dataUser.remove( elem, name );
},
// TODO: Now that all calls to _data and _removeData have been replaced
// with direct calls to dataPriv methods, these can be deprecated.
_data: function( elem, name, data ) {
return dataPriv.access( elem, name, data );
},
_removeData: function( elem, name ) {
dataPriv.remove( elem, name );
}
} );
jQuery.fn.extend( {
data: function( key, value ) {
var i, name, data,
elem = this[ 0 ],
attrs = elem && elem.attributes;
// Gets all values
if ( key === undefined ) {
if ( this.length ) {
data = dataUser.get( elem );
if ( elem.nodeType === 1 && !dataPriv.get( elem, "hasDataAttrs" ) ) {
i = attrs.length;
while ( i-- ) {
// Support: IE 11 only
// The attrs elements can be null (#14894)
if ( attrs[ i ] ) {
name = attrs[ i ].name;
if ( name.indexOf( "data-" ) === 0 ) {
name = camelCase( name.slice( 5 ) );
dataAttr( elem, name, data[ name ] );
}
}
}
dataPriv.set( elem, "hasDataAttrs", true );
}
}
return data;
}
// Sets multiple values
if ( typeof key === "object" ) {
return this.each( function() {
dataUser.set( this, key );
} );
}
return access( this, function( value ) {
var data;
// The calling jQuery object (element matches) is not empty
// (and therefore has an element appears at this[ 0 ]) and the
// `value` parameter was not undefined. An empty jQuery object
// will result in `undefined` for elem = this[ 0 ] which will
// throw an exception if an attempt to read a data cache is made.
if ( elem && value === undefined ) {
// Attempt to get data from the cache
// The key will always be camelCased in Data
data = dataUser.get( elem, key );
if ( data !== undefined ) {
return data;
}
// Attempt to "discover" the data in
// HTML5 custom data-* attrs
data = dataAttr( elem, key );
if ( data !== undefined ) {
return data;
}
// We tried really hard, but the data doesn't exist.
return;
}
// Set the data...
this.each( function() {
// We always store the camelCased key
dataUser.set( this, key, value );
} );
}, null, value, arguments.length > 1, null, true );
},
removeData: function( key ) {
return this.each( function() {
dataUser.remove( this, key );
} );
}
} );
jQuery.extend( {
queue: function( elem, type, data ) {
var queue;
if ( elem ) {
type = ( type || "fx" ) + "queue";
queue = dataPriv.get( elem, type );
// Speed up dequeue by getting out quickly if this is just a lookup
if ( data ) {
if ( !queue || Array.isArray( data ) ) {
queue = dataPriv.access( elem, type, jQuery.makeArray( data ) );
} else {
queue.push( data );
}
}
return queue || [];
}
},
dequeue: function( elem, type ) {
type = type || "fx";
var queue = jQuery.queue( elem, type ),
startLength = queue.length,
fn = queue.shift(),
hooks = jQuery._queueHooks( elem, type ),
next = function() {
jQuery.dequeue( elem, type );
};
// If the fx queue is dequeued, always remove the progress sentinel
if ( fn === "inprogress" ) {
fn = queue.shift();
startLength--;
}
if ( fn ) {
// Add a progress sentinel to prevent the fx queue from being
// automatically dequeued
if ( type === "fx" ) {
queue.unshift( "inprogress" );
}
// Clear up the last queue stop function
delete hooks.stop;
fn.call( elem, next, hooks );
}
if ( !startLength && hooks ) {
hooks.empty.fire();
}
},
// Not public - generate a queueHooks object, or return the current one
_queueHooks: function( elem, type ) {
var key = type + "queueHooks";
return dataPriv.get( elem, key ) || dataPriv.access( elem, key, {
empty: jQuery.Callbacks( "once memory" ).add( function() {
dataPriv.remove( elem, [ type + "queue", key ] );
} )
} );
}
} );
jQuery.fn.extend( {
queue: function( type, data ) {
var setter = 2;
if ( typeof type !== "string" ) {
data = type;
type = "fx";
setter--;
}
if ( arguments.length < setter ) {
return jQuery.queue( this[ 0 ], type );
}
return data === undefined ?
this :
this.each( function() {
var queue = jQuery.queue( this, type, data );
// Ensure a hooks for this queue
jQuery._queueHooks( this, type );
if ( type === "fx" && queue[ 0 ] !== "inprogress" ) {
jQuery.dequeue( this, type );
}
} );
},
dequeue: function( type ) {
return this.each( function() {
jQuery.dequeue( this, type );
} );
},
clearQueue: function( type ) {
return this.queue( type || "fx", [] );
},
// Get a promise resolved when queues of a certain type
// are emptied (fx is the type by default)
promise: function( type, obj ) {
var tmp,
count = 1,
defer = jQuery.Deferred(),
elements = this,
i = this.length,
resolve = function() {
if ( !( --count ) ) {
defer.resolveWith( elements, [ elements ] );
}
};
if ( typeof type !== "string" ) {
obj = type;
type = undefined;
}
type = type || "fx";
while ( i-- ) {
tmp = dataPriv.get( elements[ i ], type + "queueHooks" );
if ( tmp && tmp.empty ) {
count++;
tmp.empty.add( resolve );
}
}
resolve();
return defer.promise( obj );
}
} );
var pnum = ( /[+-]?(?:\d*\.|)\d+(?:[eE][+-]?\d+|)/ ).source;
var rcssNum = new RegExp( "^(?:([+-])=|)(" + pnum + ")([a-z%]*)$", "i" );
var cssExpand = [ "Top", "Right", "Bottom", "Left" ];
var documentElement = document.documentElement;
var isAttached = function( elem ) {
return jQuery.contains( elem.ownerDocument, elem );
},
composed = { composed: true };
// Support: IE 9 - 11+, Edge 12 - 18+, iOS 10.0 - 10.2 only
// Check attachment across shadow DOM boundaries when possible (gh-3504)
// Support: iOS 10.0-10.2 only
// Early iOS 10 versions support `attachShadow` but not `getRootNode`,
// leading to errors. We need to check for `getRootNode`.
if ( documentElement.getRootNode ) {
isAttached = function( elem ) {
return jQuery.contains( elem.ownerDocument, elem ) ||
elem.getRootNode( composed ) === elem.ownerDocument;
};
}
var isHiddenWithinTree = function( elem, el ) {
// isHiddenWithinTree might be called from jQuery#filter function;
// in that case, element will be second argument
elem = el || elem;
// Inline style trumps all
return elem.style.display === "none" ||
elem.style.display === "" &&
// Otherwise, check computed style
// Support: Firefox <=43 - 45
// Disconnected elements can have computed display: none, so first confirm that elem is
// in the document.
isAttached( elem ) &&
jQuery.css( elem, "display" ) === "none";
};
function adjustCSS( elem, prop, valueParts, tween ) {
var adjusted, scale,
maxIterations = 20,
currentValue = tween ?
function() {
return tween.cur();
} :
function() {
return jQuery.css( elem, prop, "" );
},
initial = currentValue(),
unit = valueParts && valueParts[ 3 ] || ( jQuery.cssNumber[ prop ] ? "" : "px" ),
// Starting value computation is required for potential unit mismatches
initialInUnit = elem.nodeType &&
( jQuery.cssNumber[ prop ] || unit !== "px" && +initial ) &&
rcssNum.exec( jQuery.css( elem, prop ) );
if ( initialInUnit && initialInUnit[ 3 ] !== unit ) {
// Support: Firefox <=54
// Halve the iteration target value to prevent interference from CSS upper bounds (gh-2144)
initial = initial / 2;
// Trust units reported by jQuery.css
unit = unit || initialInUnit[ 3 ];
// Iteratively approximate from a nonzero starting point
initialInUnit = +initial || 1;
while ( maxIterations-- ) {
// Evaluate and update our best guess (doubling guesses that zero out).
// Finish if the scale equals or crosses 1 (making the old*new product non-positive).
jQuery.style( elem, prop, initialInUnit + unit );
if ( ( 1 - scale ) * ( 1 - ( scale = currentValue() / initial || 0.5 ) ) <= 0 ) {
maxIterations = 0;
}
initialInUnit = initialInUnit / scale;
}
initialInUnit = initialInUnit * 2;
jQuery.style( elem, prop, initialInUnit + unit );
// Make sure we update the tween properties later on
valueParts = valueParts || [];
}
if ( valueParts ) {
initialInUnit = +initialInUnit || +initial || 0;
// Apply relative offset (+=/-=) if specified
adjusted = valueParts[ 1 ] ?
initialInUnit + ( valueParts[ 1 ] + 1 ) * valueParts[ 2 ] :
+valueParts[ 2 ];
if ( tween ) {
tween.unit = unit;
tween.start = initialInUnit;
tween.end = adjusted;
}
}
return adjusted;
}
var defaultDisplayMap = {};
function getDefaultDisplay( elem ) {
var temp,
doc = elem.ownerDocument,
nodeName = elem.nodeName,
display = defaultDisplayMap[ nodeName ];
if ( display ) {
return display;
}
temp = doc.body.appendChild( doc.createElement( nodeName ) );
display = jQuery.css( temp, "display" );
temp.parentNode.removeChild( temp );
if ( display === "none" ) {
display = "block";
}
defaultDisplayMap[ nodeName ] = display;
return display;
}
function showHide( elements, show ) {
var display, elem,
values = [],
index = 0,
length = elements.length;
// Determine new display value for elements that need to change
for ( ; index < length; index++ ) {
elem = elements[ index ];
if ( !elem.style ) {
continue;
}
display = elem.style.display;
if ( show ) {
// Since we force visibility upon cascade-hidden elements, an immediate (and slow)
// check is required in this first loop unless we have a nonempty display value (either
// inline or about-to-be-restored)
if ( display === "none" ) {
values[ index ] = dataPriv.get( elem, "display" ) || null;
if ( !values[ index ] ) {
elem.style.display = "";
}
}
if ( elem.style.display === "" && isHiddenWithinTree( elem ) ) {
values[ index ] = getDefaultDisplay( elem );
}
} else {
if ( display !== "none" ) {
values[ index ] = "none";
// Remember what we're overwriting
dataPriv.set( elem, "display", display );
}
}
}
// Set the display of the elements in a second loop to avoid constant reflow
for ( index = 0; index < length; index++ ) {
if ( values[ index ] != null ) {
elements[ index ].style.display = values[ index ];
}
}
return elements;
}
jQuery.fn.extend( {
show: function() {
return showHide( this, true );
},
hide: function() {
return showHide( this );
},
toggle: function( state ) {
if ( typeof state === "boolean" ) {
return state ? this.show() : this.hide();
}
return this.each( function() {
if ( isHiddenWithinTree( this ) ) {
jQuery( this ).show();
} else {
jQuery( this ).hide();
}
} );
}
} );
var rcheckableType = ( /^(?:checkbox|radio)$/i );
var rtagName = ( /<([a-z][^\/\0>\x20\t\r\n\f]*)/i );
var rscriptType = ( /^$|^module$|\/(?:java|ecma)script/i );
( function() {
var fragment = document.createDocumentFragment(),
div = fragment.appendChild( document.createElement( "div" ) ),
input = document.createElement( "input" );
// Support: Android 4.0 - 4.3 only
// Check state lost if the name is set (#11217)
// Support: Windows Web Apps (WWA)
// `name` and `type` must use .setAttribute for WWA (#14901)
input.setAttribute( "type", "radio" );
input.setAttribute( "checked", "checked" );
input.setAttribute( "name", "t" );
div.appendChild( input );
// Support: Android <=4.1 only
// Older WebKit doesn't clone checked state correctly in fragments
support.checkClone = div.cloneNode( true ).cloneNode( true ).lastChild.checked;
// Support: IE <=11 only
// Make sure textarea (and checkbox) defaultValue is properly cloned
div.innerHTML = "";
support.noCloneChecked = !!div.cloneNode( true ).lastChild.defaultValue;
// Support: IE <=9 only
// IE <=9 replaces tags with their contents when inserted outside of
// the select element.
div.innerHTML = " ";
support.option = !!div.lastChild;
} )();
// We have to close these tags to support XHTML (#13200)
var wrapMap = {
// XHTML parsers do not magically insert elements in the
// same way that tag soup parsers do. So we cannot shorten
// this by omitting or other required elements.
thead: [ 1, "" ],
col: [ 2, "" ],
tr: [ 2, "" ],
td: [ 3, "" ],
_default: [ 0, "", "" ]
};
wrapMap.tbody = wrapMap.tfoot = wrapMap.colgroup = wrapMap.caption = wrapMap.thead;
wrapMap.th = wrapMap.td;
// Support: IE <=9 only
if ( !support.option ) {
wrapMap.optgroup = wrapMap.option = [ 1, "", " " ];
}
function getAll( context, tag ) {
// Support: IE <=9 - 11 only
// Use typeof to avoid zero-argument method invocation on host objects (#15151)
var ret;
if ( typeof context.getElementsByTagName !== "undefined" ) {
ret = context.getElementsByTagName( tag || "*" );
} else if ( typeof context.querySelectorAll !== "undefined" ) {
ret = context.querySelectorAll( tag || "*" );
} else {
ret = [];
}
if ( tag === undefined || tag && nodeName( context, tag ) ) {
return jQuery.merge( [ context ], ret );
}
return ret;
}
// Mark scripts as having already been evaluated
function setGlobalEval( elems, refElements ) {
var i = 0,
l = elems.length;
for ( ; i < l; i++ ) {
dataPriv.set(
elems[ i ],
"globalEval",
!refElements || dataPriv.get( refElements[ i ], "globalEval" )
);
}
}
var rhtml = /<|?\w+;/;
function buildFragment( elems, context, scripts, selection, ignored ) {
var elem, tmp, tag, wrap, attached, j,
fragment = context.createDocumentFragment(),
nodes = [],
i = 0,
l = elems.length;
for ( ; i < l; i++ ) {
elem = elems[ i ];
if ( elem || elem === 0 ) {
// Add nodes directly
if ( toType( elem ) === "object" ) {
// Support: Android <=4.0 only, PhantomJS 1 only
// push.apply(_, arraylike) throws on ancient WebKit
jQuery.merge( nodes, elem.nodeType ? [ elem ] : elem );
// Convert non-html into a text node
} else if ( !rhtml.test( elem ) ) {
nodes.push( context.createTextNode( elem ) );
// Convert html into DOM nodes
} else {
tmp = tmp || fragment.appendChild( context.createElement( "div" ) );
// Deserialize a standard representation
tag = ( rtagName.exec( elem ) || [ "", "" ] )[ 1 ].toLowerCase();
wrap = wrapMap[ tag ] || wrapMap._default;
tmp.innerHTML = wrap[ 1 ] + jQuery.htmlPrefilter( elem ) + wrap[ 2 ];
// Descend through wrappers to the right content
j = wrap[ 0 ];
while ( j-- ) {
tmp = tmp.lastChild;
}
// Support: Android <=4.0 only, PhantomJS 1 only
// push.apply(_, arraylike) throws on ancient WebKit
jQuery.merge( nodes, tmp.childNodes );
// Remember the top-level container
tmp = fragment.firstChild;
// Ensure the created nodes are orphaned (#12392)
tmp.textContent = "";
}
}
}
// Remove wrapper from fragment
fragment.textContent = "";
i = 0;
while ( ( elem = nodes[ i++ ] ) ) {
// Skip elements already in the context collection (trac-4087)
if ( selection && jQuery.inArray( elem, selection ) > -1 ) {
if ( ignored ) {
ignored.push( elem );
}
continue;
}
attached = isAttached( elem );
// Append to fragment
tmp = getAll( fragment.appendChild( elem ), "script" );
// Preserve script evaluation history
if ( attached ) {
setGlobalEval( tmp );
}
// Capture executables
if ( scripts ) {
j = 0;
while ( ( elem = tmp[ j++ ] ) ) {
if ( rscriptType.test( elem.type || "" ) ) {
scripts.push( elem );
}
}
}
}
return fragment;
}
var rtypenamespace = /^([^.]*)(?:\.(.+)|)/;
function returnTrue() {
return true;
}
function returnFalse() {
return false;
}
// Support: IE <=9 - 11+
// focus() and blur() are asynchronous, except when they are no-op.
// So expect focus to be synchronous when the element is already active,
// and blur to be synchronous when the element is not already active.
// (focus and blur are always synchronous in other supported browsers,
// this just defines when we can count on it).
function expectSync( elem, type ) {
return ( elem === safeActiveElement() ) === ( type === "focus" );
}
// Support: IE <=9 only
// Accessing document.activeElement can throw unexpectedly
// https://bugs.jquery.com/ticket/13393
function safeActiveElement() {
try {
return document.activeElement;
} catch ( err ) { }
}
function on( elem, types, selector, data, fn, one ) {
var origFn, type;
// Types can be a map of types/handlers
if ( typeof types === "object" ) {
// ( types-Object, selector, data )
if ( typeof selector !== "string" ) {
// ( types-Object, data )
data = data || selector;
selector = undefined;
}
for ( type in types ) {
on( elem, type, selector, data, types[ type ], one );
}
return elem;
}
if ( data == null && fn == null ) {
// ( types, fn )
fn = selector;
data = selector = undefined;
} else if ( fn == null ) {
if ( typeof selector === "string" ) {
// ( types, selector, fn )
fn = data;
data = undefined;
} else {
// ( types, data, fn )
fn = data;
data = selector;
selector = undefined;
}
}
if ( fn === false ) {
fn = returnFalse;
} else if ( !fn ) {
return elem;
}
if ( one === 1 ) {
origFn = fn;
fn = function( event ) {
// Can use an empty set, since event contains the info
jQuery().off( event );
return origFn.apply( this, arguments );
};
// Use same guid so caller can remove using origFn
fn.guid = origFn.guid || ( origFn.guid = jQuery.guid++ );
}
return elem.each( function() {
jQuery.event.add( this, types, fn, data, selector );
} );
}
/*
* Helper functions for managing events -- not part of the public interface.
* Props to Dean Edwards' addEvent library for many of the ideas.
*/
jQuery.event = {
global: {},
add: function( elem, types, handler, data, selector ) {
var handleObjIn, eventHandle, tmp,
events, t, handleObj,
special, handlers, type, namespaces, origType,
elemData = dataPriv.get( elem );
// Only attach events to objects that accept data
if ( !acceptData( elem ) ) {
return;
}
// Caller can pass in an object of custom data in lieu of the handler
if ( handler.handler ) {
handleObjIn = handler;
handler = handleObjIn.handler;
selector = handleObjIn.selector;
}
// Ensure that invalid selectors throw exceptions at attach time
// Evaluate against documentElement in case elem is a non-element node (e.g., document)
if ( selector ) {
jQuery.find.matchesSelector( documentElement, selector );
}
// Make sure that the handler has a unique ID, used to find/remove it later
if ( !handler.guid ) {
handler.guid = jQuery.guid++;
}
// Init the element's event structure and main handler, if this is the first
if ( !( events = elemData.events ) ) {
events = elemData.events = Object.create( null );
}
if ( !( eventHandle = elemData.handle ) ) {
eventHandle = elemData.handle = function( e ) {
// Discard the second event of a jQuery.event.trigger() and
// when an event is called after a page has unloaded
return typeof jQuery !== "undefined" && jQuery.event.triggered !== e.type ?
jQuery.event.dispatch.apply( elem, arguments ) : undefined;
};
}
// Handle multiple events separated by a space
types = ( types || "" ).match( rnothtmlwhite ) || [ "" ];
t = types.length;
while ( t-- ) {
tmp = rtypenamespace.exec( types[ t ] ) || [];
type = origType = tmp[ 1 ];
namespaces = ( tmp[ 2 ] || "" ).split( "." ).sort();
// There *must* be a type, no attaching namespace-only handlers
if ( !type ) {
continue;
}
// If event changes its type, use the special event handlers for the changed type
special = jQuery.event.special[ type ] || {};
// If selector defined, determine special event api type, otherwise given type
type = ( selector ? special.delegateType : special.bindType ) || type;
// Update special based on newly reset type
special = jQuery.event.special[ type ] || {};
// handleObj is passed to all event handlers
handleObj = jQuery.extend( {
type: type,
origType: origType,
data: data,
handler: handler,
guid: handler.guid,
selector: selector,
needsContext: selector && jQuery.expr.match.needsContext.test( selector ),
namespace: namespaces.join( "." )
}, handleObjIn );
// Init the event handler queue if we're the first
if ( !( handlers = events[ type ] ) ) {
handlers = events[ type ] = [];
handlers.delegateCount = 0;
// Only use addEventListener if the special events handler returns false
if ( !special.setup ||
special.setup.call( elem, data, namespaces, eventHandle ) === false ) {
if ( elem.addEventListener ) {
elem.addEventListener( type, eventHandle );
}
}
}
if ( special.add ) {
special.add.call( elem, handleObj );
if ( !handleObj.handler.guid ) {
handleObj.handler.guid = handler.guid;
}
}
// Add to the element's handler list, delegates in front
if ( selector ) {
handlers.splice( handlers.delegateCount++, 0, handleObj );
} else {
handlers.push( handleObj );
}
// Keep track of which events have ever been used, for event optimization
jQuery.event.global[ type ] = true;
}
},
// Detach an event or set of events from an element
remove: function( elem, types, handler, selector, mappedTypes ) {
var j, origCount, tmp,
events, t, handleObj,
special, handlers, type, namespaces, origType,
elemData = dataPriv.hasData( elem ) && dataPriv.get( elem );
if ( !elemData || !( events = elemData.events ) ) {
return;
}
// Once for each type.namespace in types; type may be omitted
types = ( types || "" ).match( rnothtmlwhite ) || [ "" ];
t = types.length;
while ( t-- ) {
tmp = rtypenamespace.exec( types[ t ] ) || [];
type = origType = tmp[ 1 ];
namespaces = ( tmp[ 2 ] || "" ).split( "." ).sort();
// Unbind all events (on this namespace, if provided) for the element
if ( !type ) {
for ( type in events ) {
jQuery.event.remove( elem, type + types[ t ], handler, selector, true );
}
continue;
}
special = jQuery.event.special[ type ] || {};
type = ( selector ? special.delegateType : special.bindType ) || type;
handlers = events[ type ] || [];
tmp = tmp[ 2 ] &&
new RegExp( "(^|\\.)" + namespaces.join( "\\.(?:.*\\.|)" ) + "(\\.|$)" );
// Remove matching events
origCount = j = handlers.length;
while ( j-- ) {
handleObj = handlers[ j ];
if ( ( mappedTypes || origType === handleObj.origType ) &&
( !handler || handler.guid === handleObj.guid ) &&
( !tmp || tmp.test( handleObj.namespace ) ) &&
( !selector || selector === handleObj.selector ||
selector === "**" && handleObj.selector ) ) {
handlers.splice( j, 1 );
if ( handleObj.selector ) {
handlers.delegateCount--;
}
if ( special.remove ) {
special.remove.call( elem, handleObj );
}
}
}
// Remove generic event handler if we removed something and no more handlers exist
// (avoids potential for endless recursion during removal of special event handlers)
if ( origCount && !handlers.length ) {
if ( !special.teardown ||
special.teardown.call( elem, namespaces, elemData.handle ) === false ) {
jQuery.removeEvent( elem, type, elemData.handle );
}
delete events[ type ];
}
}
// Remove data and the expando if it's no longer used
if ( jQuery.isEmptyObject( events ) ) {
dataPriv.remove( elem, "handle events" );
}
},
dispatch: function( nativeEvent ) {
var i, j, ret, matched, handleObj, handlerQueue,
args = new Array( arguments.length ),
// Make a writable jQuery.Event from the native event object
event = jQuery.event.fix( nativeEvent ),
handlers = (
dataPriv.get( this, "events" ) || Object.create( null )
)[ event.type ] || [],
special = jQuery.event.special[ event.type ] || {};
// Use the fix-ed jQuery.Event rather than the (read-only) native event
args[ 0 ] = event;
for ( i = 1; i < arguments.length; i++ ) {
args[ i ] = arguments[ i ];
}
event.delegateTarget = this;
// Call the preDispatch hook for the mapped type, and let it bail if desired
if ( special.preDispatch && special.preDispatch.call( this, event ) === false ) {
return;
}
// Determine handlers
handlerQueue = jQuery.event.handlers.call( this, event, handlers );
// Run delegates first; they may want to stop propagation beneath us
i = 0;
while ( ( matched = handlerQueue[ i++ ] ) && !event.isPropagationStopped() ) {
event.currentTarget = matched.elem;
j = 0;
while ( ( handleObj = matched.handlers[ j++ ] ) &&
!event.isImmediatePropagationStopped() ) {
// If the event is namespaced, then each handler is only invoked if it is
// specially universal or its namespaces are a superset of the event's.
if ( !event.rnamespace || handleObj.namespace === false ||
event.rnamespace.test( handleObj.namespace ) ) {
event.handleObj = handleObj;
event.data = handleObj.data;
ret = ( ( jQuery.event.special[ handleObj.origType ] || {} ).handle ||
handleObj.handler ).apply( matched.elem, args );
if ( ret !== undefined ) {
if ( ( event.result = ret ) === false ) {
event.preventDefault();
event.stopPropagation();
}
}
}
}
}
// Call the postDispatch hook for the mapped type
if ( special.postDispatch ) {
special.postDispatch.call( this, event );
}
return event.result;
},
handlers: function( event, handlers ) {
var i, handleObj, sel, matchedHandlers, matchedSelectors,
handlerQueue = [],
delegateCount = handlers.delegateCount,
cur = event.target;
// Find delegate handlers
if ( delegateCount &&
// Support: IE <=9
// Black-hole SVG instance trees (trac-13180)
cur.nodeType &&
// Support: Firefox <=42
// Suppress spec-violating clicks indicating a non-primary pointer button (trac-3861)
// https://www.w3.org/TR/DOM-Level-3-Events/#event-type-click
// Support: IE 11 only
// ...but not arrow key "clicks" of radio inputs, which can have `button` -1 (gh-2343)
!( event.type === "click" && event.button >= 1 ) ) {
for ( ; cur !== this; cur = cur.parentNode || this ) {
// Don't check non-elements (#13208)
// Don't process clicks on disabled elements (#6911, #8165, #11382, #11764)
if ( cur.nodeType === 1 && !( event.type === "click" && cur.disabled === true ) ) {
matchedHandlers = [];
matchedSelectors = {};
for ( i = 0; i < delegateCount; i++ ) {
handleObj = handlers[ i ];
// Don't conflict with Object.prototype properties (#13203)
sel = handleObj.selector + " ";
if ( matchedSelectors[ sel ] === undefined ) {
matchedSelectors[ sel ] = handleObj.needsContext ?
jQuery( sel, this ).index( cur ) > -1 :
jQuery.find( sel, this, null, [ cur ] ).length;
}
if ( matchedSelectors[ sel ] ) {
matchedHandlers.push( handleObj );
}
}
if ( matchedHandlers.length ) {
handlerQueue.push( { elem: cur, handlers: matchedHandlers } );
}
}
}
}
// Add the remaining (directly-bound) handlers
cur = this;
if ( delegateCount < handlers.length ) {
handlerQueue.push( { elem: cur, handlers: handlers.slice( delegateCount ) } );
}
return handlerQueue;
},
addProp: function( name, hook ) {
Object.defineProperty( jQuery.Event.prototype, name, {
enumerable: true,
configurable: true,
get: isFunction( hook ) ?
function() {
if ( this.originalEvent ) {
return hook( this.originalEvent );
}
} :
function() {
if ( this.originalEvent ) {
return this.originalEvent[ name ];
}
},
set: function( value ) {
Object.defineProperty( this, name, {
enumerable: true,
configurable: true,
writable: true,
value: value
} );
}
} );
},
fix: function( originalEvent ) {
return originalEvent[ jQuery.expando ] ?
originalEvent :
new jQuery.Event( originalEvent );
},
special: {
load: {
// Prevent triggered image.load events from bubbling to window.load
noBubble: true
},
click: {
// Utilize native event to ensure correct state for checkable inputs
setup: function( data ) {
// For mutual compressibility with _default, replace `this` access with a local var.
// `|| data` is dead code meant only to preserve the variable through minification.
var el = this || data;
// Claim the first handler
if ( rcheckableType.test( el.type ) &&
el.click && nodeName( el, "input" ) ) {
// dataPriv.set( el, "click", ... )
leverageNative( el, "click", returnTrue );
}
// Return false to allow normal processing in the caller
return false;
},
trigger: function( data ) {
// For mutual compressibility with _default, replace `this` access with a local var.
// `|| data` is dead code meant only to preserve the variable through minification.
var el = this || data;
// Force setup before triggering a click
if ( rcheckableType.test( el.type ) &&
el.click && nodeName( el, "input" ) ) {
leverageNative( el, "click" );
}
// Return non-false to allow normal event-path propagation
return true;
},
// For cross-browser consistency, suppress native .click() on links
// Also prevent it if we're currently inside a leveraged native-event stack
_default: function( event ) {
var target = event.target;
return rcheckableType.test( target.type ) &&
target.click && nodeName( target, "input" ) &&
dataPriv.get( target, "click" ) ||
nodeName( target, "a" );
}
},
beforeunload: {
postDispatch: function( event ) {
// Support: Firefox 20+
// Firefox doesn't alert if the returnValue field is not set.
if ( event.result !== undefined && event.originalEvent ) {
event.originalEvent.returnValue = event.result;
}
}
}
}
};
// Ensure the presence of an event listener that handles manually-triggered
// synthetic events by interrupting progress until reinvoked in response to
// *native* events that it fires directly, ensuring that state changes have
// already occurred before other listeners are invoked.
function leverageNative( el, type, expectSync ) {
// Missing expectSync indicates a trigger call, which must force setup through jQuery.event.add
if ( !expectSync ) {
if ( dataPriv.get( el, type ) === undefined ) {
jQuery.event.add( el, type, returnTrue );
}
return;
}
// Register the controller as a special universal handler for all event namespaces
dataPriv.set( el, type, false );
jQuery.event.add( el, type, {
namespace: false,
handler: function( event ) {
var notAsync, result,
saved = dataPriv.get( this, type );
if ( ( event.isTrigger & 1 ) && this[ type ] ) {
// Interrupt processing of the outer synthetic .trigger()ed event
// Saved data should be false in such cases, but might be a leftover capture object
// from an async native handler (gh-4350)
if ( !saved.length ) {
// Store arguments for use when handling the inner native event
// There will always be at least one argument (an event object), so this array
// will not be confused with a leftover capture object.
saved = slice.call( arguments );
dataPriv.set( this, type, saved );
// Trigger the native event and capture its result
// Support: IE <=9 - 11+
// focus() and blur() are asynchronous
notAsync = expectSync( this, type );
this[ type ]();
result = dataPriv.get( this, type );
if ( saved !== result || notAsync ) {
dataPriv.set( this, type, false );
} else {
result = {};
}
if ( saved !== result ) {
// Cancel the outer synthetic event
event.stopImmediatePropagation();
event.preventDefault();
// Support: Chrome 86+
// In Chrome, if an element having a focusout handler is blurred by
// clicking outside of it, it invokes the handler synchronously. If
// that handler calls `.remove()` on the element, the data is cleared,
// leaving `result` undefined. We need to guard against this.
return result && result.value;
}
// If this is an inner synthetic event for an event with a bubbling surrogate
// (focus or blur), assume that the surrogate already propagated from triggering the
// native event and prevent that from happening again here.
// This technically gets the ordering wrong w.r.t. to `.trigger()` (in which the
// bubbling surrogate propagates *after* the non-bubbling base), but that seems
// less bad than duplication.
} else if ( ( jQuery.event.special[ type ] || {} ).delegateType ) {
event.stopPropagation();
}
// If this is a native event triggered above, everything is now in order
// Fire an inner synthetic event with the original arguments
} else if ( saved.length ) {
// ...and capture the result
dataPriv.set( this, type, {
value: jQuery.event.trigger(
// Support: IE <=9 - 11+
// Extend with the prototype to reset the above stopImmediatePropagation()
jQuery.extend( saved[ 0 ], jQuery.Event.prototype ),
saved.slice( 1 ),
this
)
} );
// Abort handling of the native event
event.stopImmediatePropagation();
}
}
} );
}
jQuery.removeEvent = function( elem, type, handle ) {
// This "if" is needed for plain objects
if ( elem.removeEventListener ) {
elem.removeEventListener( type, handle );
}
};
jQuery.Event = function( src, props ) {
// Allow instantiation without the 'new' keyword
if ( !( this instanceof jQuery.Event ) ) {
return new jQuery.Event( src, props );
}
// Event object
if ( src && src.type ) {
this.originalEvent = src;
this.type = src.type;
// Events bubbling up the document may have been marked as prevented
// by a handler lower down the tree; reflect the correct value.
this.isDefaultPrevented = src.defaultPrevented ||
src.defaultPrevented === undefined &&
// Support: Android <=2.3 only
src.returnValue === false ?
returnTrue :
returnFalse;
// Create target properties
// Support: Safari <=6 - 7 only
// Target should not be a text node (#504, #13143)
this.target = ( src.target && src.target.nodeType === 3 ) ?
src.target.parentNode :
src.target;
this.currentTarget = src.currentTarget;
this.relatedTarget = src.relatedTarget;
// Event type
} else {
this.type = src;
}
// Put explicitly provided properties onto the event object
if ( props ) {
jQuery.extend( this, props );
}
// Create a timestamp if incoming event doesn't have one
this.timeStamp = src && src.timeStamp || Date.now();
// Mark it as fixed
this[ jQuery.expando ] = true;
};
// jQuery.Event is based on DOM3 Events as specified by the ECMAScript Language Binding
// https://www.w3.org/TR/2003/WD-DOM-Level-3-Events-20030331/ecma-script-binding.html
jQuery.Event.prototype = {
constructor: jQuery.Event,
isDefaultPrevented: returnFalse,
isPropagationStopped: returnFalse,
isImmediatePropagationStopped: returnFalse,
isSimulated: false,
preventDefault: function() {
var e = this.originalEvent;
this.isDefaultPrevented = returnTrue;
if ( e && !this.isSimulated ) {
e.preventDefault();
}
},
stopPropagation: function() {
var e = this.originalEvent;
this.isPropagationStopped = returnTrue;
if ( e && !this.isSimulated ) {
e.stopPropagation();
}
},
stopImmediatePropagation: function() {
var e = this.originalEvent;
this.isImmediatePropagationStopped = returnTrue;
if ( e && !this.isSimulated ) {
e.stopImmediatePropagation();
}
this.stopPropagation();
}
};
// Includes all common event props including KeyEvent and MouseEvent specific props
jQuery.each( {
altKey: true,
bubbles: true,
cancelable: true,
changedTouches: true,
ctrlKey: true,
detail: true,
eventPhase: true,
metaKey: true,
pageX: true,
pageY: true,
shiftKey: true,
view: true,
"char": true,
code: true,
charCode: true,
key: true,
keyCode: true,
button: true,
buttons: true,
clientX: true,
clientY: true,
offsetX: true,
offsetY: true,
pointerId: true,
pointerType: true,
screenX: true,
screenY: true,
targetTouches: true,
toElement: true,
touches: true,
which: true
}, jQuery.event.addProp );
jQuery.each( { focus: "focusin", blur: "focusout" }, function( type, delegateType ) {
jQuery.event.special[ type ] = {
// Utilize native event if possible so blur/focus sequence is correct
setup: function() {
// Claim the first handler
// dataPriv.set( this, "focus", ... )
// dataPriv.set( this, "blur", ... )
leverageNative( this, type, expectSync );
// Return false to allow normal processing in the caller
return false;
},
trigger: function() {
// Force setup before trigger
leverageNative( this, type );
// Return non-false to allow normal event-path propagation
return true;
},
// Suppress native focus or blur as it's already being fired
// in leverageNative.
_default: function() {
return true;
},
delegateType: delegateType
};
} );
// Create mouseenter/leave events using mouseover/out and event-time checks
// so that event delegation works in jQuery.
// Do the same for pointerenter/pointerleave and pointerover/pointerout
//
// Support: Safari 7 only
// Safari sends mouseenter too often; see:
// https://bugs.chromium.org/p/chromium/issues/detail?id=470258
// for the description of the bug (it existed in older Chrome versions as well).
jQuery.each( {
mouseenter: "mouseover",
mouseleave: "mouseout",
pointerenter: "pointerover",
pointerleave: "pointerout"
}, function( orig, fix ) {
jQuery.event.special[ orig ] = {
delegateType: fix,
bindType: fix,
handle: function( event ) {
var ret,
target = this,
related = event.relatedTarget,
handleObj = event.handleObj;
// For mouseenter/leave call the handler if related is outside the target.
// NB: No relatedTarget if the mouse left/entered the browser window
if ( !related || ( related !== target && !jQuery.contains( target, related ) ) ) {
event.type = handleObj.origType;
ret = handleObj.handler.apply( this, arguments );
event.type = fix;
}
return ret;
}
};
} );
jQuery.fn.extend( {
on: function( types, selector, data, fn ) {
return on( this, types, selector, data, fn );
},
one: function( types, selector, data, fn ) {
return on( this, types, selector, data, fn, 1 );
},
off: function( types, selector, fn ) {
var handleObj, type;
if ( types && types.preventDefault && types.handleObj ) {
// ( event ) dispatched jQuery.Event
handleObj = types.handleObj;
jQuery( types.delegateTarget ).off(
handleObj.namespace ?
handleObj.origType + "." + handleObj.namespace :
handleObj.origType,
handleObj.selector,
handleObj.handler
);
return this;
}
if ( typeof types === "object" ) {
// ( types-object [, selector] )
for ( type in types ) {
this.off( type, selector, types[ type ] );
}
return this;
}
if ( selector === false || typeof selector === "function" ) {
// ( types [, fn] )
fn = selector;
selector = undefined;
}
if ( fn === false ) {
fn = returnFalse;
}
return this.each( function() {
jQuery.event.remove( this, types, fn, selector );
} );
}
} );
var
// Support: IE <=10 - 11, Edge 12 - 13 only
// In IE/Edge using regex groups here causes severe slowdowns.
// See https://connect.microsoft.com/IE/feedback/details/1736512/
rnoInnerhtml = /