[大数据] 小福利3，带你用Python里面的正则表达式爬取百度全球疫情大数据

开发: C++知识库 Java知识库 JavaScript Python PHP知识库人工智能区块链大数据移动开发嵌入式开发工具数据结构与算法开发测试游戏开发网络协议系统运维
教程: HTML教程 CSS教程 JavaScript教程 Go语言教程 JQuery教程 VUE教程 VUE3教程 Bootstrap教程 SQL数据库教程 C语言教程 C++教程 Java教程 Python教程 Python3教程 C#教程
数码: 电脑笔记本显卡显示器固态硬盘硬盘耳机手机 iphone vivo oppo 小米华为单反装机图拉丁

-> 大数据 -> 小福利3，带你用Python里面的正则表达式爬取百度全球疫情大数据 -> 正文阅读

[大数据]小福利3，带你用Python里面的正则表达式爬取百度全球疫情大数据

大家好，我是天空之城，今天给大家带来小福利3，带你用Python里面的正则表达式爬取百度全球疫情大数据，效率杠杠滴！

import requests,re
headers = {
        'Referer': 'http://www.voice.baidu.com/',
        'Origin':'http://www.voice.baidu.com/',
        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.163 Safari/537.36'
    }

url='https://voice.baidu.com/act/newpneumonia/newpneumonia/?from=osari_aladin_banner&city=%E7%BE%8E%E5%9B%BD-%E7%BE%8E%E5%9B%BD'
res=requests.get(url=url,headers=headers).text
result=re.findall('"city":"(.*?)","cityCode"',res)
# print(result)
for i in result:
    am=bytes(i,'utf-8')
    print(am.decode('unicode-escape'))

爬取数据截图如下:
在这里插入图片描述
进一步处理得到：

import requests,re
headers = {
        'Referer': 'http://www.voice.baidu.com/',
        'Origin':'http://www.voice.baidu.com/',
        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.163 Safari/537.36',


    }

url='https://voice.baidu.com/act/newpneumonia/newpneumonia/?from=osari_aladin_banner&city=%E7%BE%8E%E5%9B%BD-%E7%BE%8E%E5%9B%BD'
res=requests.get(url=url,headers=headers).text
result=re.findall('"city":"(.*?)","cityCode"',res)
# print(result)
for i in result:

    am=bytes(i,'utf-8')

    # print(am.decode('unicode-escape'))
    amn=am.decode('unicode-escape')

    ams=amn.replace("crued","治愈").replace("confirmedRelative","确诊相关").replace("died","死亡").replace("confirmed","确诊").replace("asymptomaticRelative","无症状相关").replace("nativeRelative","本土相关").replace("curConfirm","确诊治愈").replace("asymptomatic","无症状").replace("crued","治愈")

    print(ams)

处理后数据截图得到：
在这里插入图片描述

下面捕捉一下其他国家的疫情数据：

import requests,re
headers = {
        'Referer': 'http://www.voice.baidu.com/',
        'Origin':'http://www.voice.baidu.com/',
        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.163 Safari/537.36',


    }

url='https://voice.baidu.com/act/newpneumonia/newpneumonia/?from=osari_aladin_banner&city=%E7%BE%8E%E5%9B%BD-%E7%BE%8E%E5%9B%BD'
res=requests.get(url=url,headers=headers).text
result=re.findall('"city":"(.*?)","diedPercent"',res)
# print(result)
for i in result:

    am=bytes(i,'utf-8')

    # print(am.decode('unicode-escape'))
    amn=am.decode('unicode-escape')
    # print(amn)

    # ams=amn.replace("crued","治愈").replace("confirmedRelative","确诊相关").replace("died","死亡").replace("confirmed","确诊").replace("asymptomaticRelative","无症状相关").replace("nativeRelative","本土相关").replace("curConfirm","确诊治愈").replace("asymptomatic","无症状").replace("crued","治愈")

    ams = amn.replace("died", "死亡").replace("diedPercent", "死亡率").replace("crued", "治愈").replace("confirmedRelative", "确诊相关").replace("confirmed","确诊").replace("curedPercent", "治愈率").replace("curConfirm", "确诊治愈")


    print(ams)