{"topic":{"id":5255,"title":"播客推荐","slug":"topic","userId":677,"categoryId":11,"createdAt":"2023-08-28 14:49:52.248903","bumpedAt":"2023-08-29 08:06:31.222138","views":289,"postsCount":3,"highestPostNumber":3,"likeCount":1,"closed":false,"pinned":false,"pinnedGlobally":false,"pinnedAt":null,"pinnedUntil":null,"isBanner":false,"excerpt":"最近感觉播客不够听，大家来推荐一下自己喜欢的高质量播客吧！我先来推荐几个：时政类：不明白播客影视类：没折腰 FM、反派影评资讯简报类：No News Is Good News 今日无事发生、声动早咖啡脱口秀类：谐星聊天会其他：裸辞后的快乐生活","deletedAt":null,"isAnonymous":false,"isPrivate":false,"isMembersOnly":false,"category":{"id":11,"name":"深入交流","slug":"distilled","color":"c01c28"},"author":{"id":677,"username":"Aftersun","name":null,"avatarUrl":null},"realAuthor":{"id":677,"username":"Aftersun","name":null,"avatarUrl":null},"tags":[]},"posts":[{"id":10140,"postNumber":1,"raw":"最近感觉播客不够听，大家来推荐一下自己喜欢的高质量播客吧！\n我先来推荐几个：\n**时政类**：不明白播客\n\n**影视类**：没折腰 FM、反派影评\n\n**资讯简报类**：No News Is Good News 今日无事发生、声动早咖啡\n\n**脱口秀类**：谐星聊天会\n\n**其他**：裸辞后的快乐生活","cooked":"

最近感觉播客不够听，大家来推荐一下自己喜欢的高质量播客吧！
\n我先来推荐几个：
\n时政类：不明白播客

影视类：没折腰 FM、反派影评

资讯简报类：No News Is Good News 今日无事发生、声动早咖啡

脱口秀类：谐星聊天会

其他：裸辞后的快乐生活

\n","createdAt":"2023-08-28 14:49:52.333037","updatedAt":"2023-08-29 02:43:45.118064","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":106,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":6,"publicVersion":6,"deletedAt":null,"isAnonymous":false,"user":{"id":677,"username":"Aftersun","name":null,"avatarUrl":null,"admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":10142,"postNumber":2,"raw":"我来几个 BBC World Service 的 podcast：\n[latest five minute news bulletin](https://www.bbc.co.uk/programmes/p002vsmz)\n[Business Matters](https://www.bbc.co.uk/programmes/p016tl04)\n[Global News Podcast](https://www.bbc.co.uk/programmes/p02nq0gn)\n\n\n官方 BBC Sounds App 访问太慢，我写了一个脚本用 cron 定时运行，缓存下来（虽然他们用了 CloudFront，但每个节目的下载速度连在美国访问都只有几百 K/s）：\n```python\n#!/usr/bin/env python3\nimport dataclasses\nimport logging\nimport os\nfrom collections import namedtuple\nfrom pathlib import Path\n\nimport redis\n\nr = redis.Redis(host='localhost', port=6379, db=0)\n\nimport yt_dlp\n\nbbcroot = os.environ.get('BBCROOT')\nif bbcroot is None:\n bbcroot = '/tmp/bbc_dl/'\n logging.warning(f'BBCROOT not set, using default: {bbcroot}')\nsaving_dir = Path(bbcroot)\nsaving_dir.mkdir(exist_ok=True)\nimport requests\n\nUA = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:108.0) Gecko/20100101 Firefox/108.0'\n\nsession = requests.Session()\nfrom lxml import etree\n\n# sometimes, when an episode has come too soon, it may says 'This episode will be available soon', so a second_audio_xpath is helpful\nProgram = namedtuple('Program', ['program_link', 'first_audio_xpath', 'second_audio_xpath', 'type'])\n\n\nclass Programs():\n items = []\n\n def __init__(self, *args):\n # automatically add to class attr when init\n Programs.items.append(Program(*args))\n\n @classmethod\n def list_objects(cls):\n return cls.items\n\n\n@dataclasses.dataclass\nclass Link:\n url: str\n saving_path: str\n\n\nclass BBCPrograms(Programs):\n def __init__(self, *args):\n super().__init__(*args, 'bbc')\n\n\nclass BBCRegularPrograms(BBCPrograms):\n # or another viable URL+selector\n # BBCPrograms('https://www.bbc.co.uk/sounds/series/p02nq0gn',\n # '/html/body/div[2]/div/div/div/div/div[2]/div/ul/li[1]/article/a',\n # '/html/body/div[2]/div/div/div/div/div[2]/div/ul/li[2]/article/a')\n episodes_player_first_audio_xpath = '/html/body/div[6]/div/div/div[2]/div[4]/ol[1]/div[1]/div[2]/h2/a'\n episodes_player_second_audio_xpath = '/html/body/div[6]/div/div/div[2]/div[4]/ol[1]/div[2]/div[2]/h2/a'\n\n def __init__(self, id):\n super().__init__(f'https://www.bbc.co.uk/programmes/{id}/episodes/player',\n BBCRegularPrograms.episodes_player_first_audio_xpath,\n BBCRegularPrograms.episodes_player_second_audio_xpath)\n\n\nclass NPRPrograms(Programs):\n def __init__(self, *args):\n # NPR program does not have a second_audio_xpath\n super().__init__(*args, '', 'npr')\n\n\nFive_Min_News = BBCRegularPrograms('p002vsmz')\nGlobal_News_Podcast = BBCRegularPrograms('p02nq0gn')\nTech_Life = BBCRegularPrograms('p01plr2p')\nWitness_History = BBCRegularPrograms('p004t1hd')\nBusiness_Matters = BBCRegularPrograms('p016tl04')\nNewsday = BBCRegularPrograms('p00w940j')\nThe_Newsroom = BBCRegularPrograms('p016tklr')\nNewshour = BBCRegularPrograms('p002vsnk')\nWorld_Business_Report = BBCRegularPrograms('p00fvhj7')\nThe_Real_Story = BBCRegularPrograms('p02dbd4m')\n\ndef printError(*args):\n CRED = '\\033[91m'\n CEND = '\\033[0m'\n print(CRED, *args, CEND, sep='')\n\n\nlinks = []\nfor target in Programs.list_objects():\n page_html = session.get(target.program_link)\n tree = etree.HTML(page_html.text)\n title = tree.findtext('.//title')\n first_program_link = tree.xpath(target.first_audio_xpath)[0].attrib['href']\n second_program_link = tree.xpath(target.second_audio_xpath)[0].attrib['href']\n if not first_program_link.startswith('https://'):\n first_program_link = f'https://www.bbc.co.uk{first_program_link}'\n if not second_program_link.startswith('https://'):\n second_program_link = f'https://www.bbc.co.uk{second_program_link}'\n middle_title = title.split(' - ')[1].strip()\n links.append(Link(first_program_link, saving_dir / middle_title))\n links.append(Link(second_program_link, saving_dir / middle_title))\n\n\ndef dl_link(link):\n url = link.url\n saving_path = link.saving_path\n if (got := r.get(url)) is not None:\n got = got.decode()\n if got in ['downloaded', 'handling']:\n print(f'{url} has already been downloaded')\n else:\n r.set(url, 'handling') # write-lock\n # direct yt-dlp call doesn't give you extra info\n # # os.system(f'cd ~/Music/bbc; proxychains yt-dlp \"{latest_program_url}\"')\n # p = Popen(shlex.split(f'proxychains yt-dlp \"{latest_program_url}\"'),\n # cwd=saving_dir,\n # stdout=PIPE, stderr=PIPE)\n # out, err = p.communicate()\n # if len(err) != 0:\n # pass\n # else:\n # pass # insert to db\n saving_path.mkdir(parents=True, exist_ok=True)\n ydl = yt_dlp.YoutubeDL({'paths': {'home': str(saving_path)}})\n try:\n info = ydl.extract_info(url)\n if info is not None:\n r.set(url, 'downloaded')\n else: # empty file\n printError(info)\n r.set(url, 'failed')\n except Exception as e:\n printError(e)\n r.set(url, 'failed')\n\nimport multiprocessing as mp\n\npool = mp.Pool(processes=6)\nres = pool.map(dl_link, links)\n\n\nfor pod_subdir in saving_dir.glob('*'):\n if pod_subdir.is_dir():\n try:\n list_of_files = pod_subdir.glob('*')\n latest_path = max(list_of_files, key=lambda p: p.stat().st_ctime)\n sym_src_path = pod_subdir / latest_path.name\n sym_dst_path = saving_dir / f'{pod_subdir}{latest_path.suffix}' # `suffix` itself has '.'\n # os.symlink(sym_src_path, sym_dst_path) # does not support overwrite\n os.system(f'ln -sf \"{sym_src_path}\" \"{sym_dst_path}\"')\n except Exception as e:\n printError(e)\n else:\n if not pod_subdir.is_symlink():\n printError(f'we should NOT have files in subdir: {pod_subdir}')\n # shutil.move(pod_subdir, saving_dir / pod_subdir.name.split(',')[0])\n\n# delete old files\nos.system(f'find {bbcroot} -mtime +7 -type f -delete')\n# if complains about already downloaded while it's not, then delete the key in redis\n```","cooked":"

我来几个 BBC World Service 的 podcast：
\nlatest five minute news bulletin
\nBusiness Matters
\nGlobal News Podcast

官方 BBC Sounds App 访问太慢，我写了一个脚本用 cron 定时运行，缓存下来（虽然他们用了 CloudFront，但每个节目的下载速度连在美国访问都只有几百 K/s）：

#!/usr/bin/env python3\nimport dataclasses\nimport logging\nimport os\nfrom collections import namedtuple\nfrom pathlib import Path\n\nimport redis\n\nr = redis.Redis(host='localhost', port=6379, db=0)\n\nimport yt_dlp\n\nbbcroot = os.environ.get('BBCROOT')\nif bbcroot is None:\n    bbcroot = '/tmp/bbc_dl/'\n    logging.warning(f'BBCROOT not set, using default: {bbcroot}')\nsaving_dir = Path(bbcroot)\nsaving_dir.mkdir(exist_ok=True)\nimport requests\n\nUA = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:108.0) Gecko/20100101 Firefox/108.0'\n\nsession = requests.Session()\nfrom lxml import etree\n\n# sometimes, when an episode has come too soon, it may says 'This episode will be available soon', so a second_audio_xpath is helpful\nProgram = namedtuple('Program', ['program_link', 'first_audio_xpath', 'second_audio_xpath', 'type'])\n\n\nclass Programs():\n    items = []\n\n    def __init__(self, *args):\n        # automatically add to class attr when init\n        Programs.items.append(Program(*args))\n\n    @classmethod\n    def list_objects(cls):\n        return cls.items\n\n\n@dataclasses.dataclass\nclass Link:\n    url: str\n    saving_path: str\n\n\nclass BBCPrograms(Programs):\n    def __init__(self, *args):\n        super().__init__(*args, 'bbc')\n\n\nclass BBCRegularPrograms(BBCPrograms):\n    # or another viable URL+selector\n    # BBCPrograms('https://www.bbc.co.uk/sounds/series/p02nq0gn',\n    #                                   '/html/body/div[2]/div/div/div/div/div[2]/div/ul/li[1]/article/a',\n    #                                   '/html/body/div[2]/div/div/div/div/div[2]/div/ul/li[2]/article/a')\n    episodes_player_first_audio_xpath = '/html/body/div[6]/div/div/div[2]/div[4]/ol[1]/div[1]/div[2]/h2/a'\n    episodes_player_second_audio_xpath = '/html/body/div[6]/div/div/div[2]/div[4]/ol[1]/div[2]/div[2]/h2/a'\n\n    def __init__(self, id):\n        super().__init__(f'https://www.bbc.co.uk/programmes/{id}/episodes/player',\n                         BBCRegularPrograms.episodes_player_first_audio_xpath,\n                         BBCRegularPrograms.episodes_player_second_audio_xpath)\n\n\nclass NPRPrograms(Programs):\n    def __init__(self, *args):\n        # NPR program does not have a second_audio_xpath\n        super().__init__(*args, '', 'npr')\n\n\nFive_Min_News = BBCRegularPrograms('p002vsmz')\nGlobal_News_Podcast = BBCRegularPrograms('p02nq0gn')\nTech_Life = BBCRegularPrograms('p01plr2p')\nWitness_History = BBCRegularPrograms('p004t1hd')\nBusiness_Matters = BBCRegularPrograms('p016tl04')\nNewsday = BBCRegularPrograms('p00w940j')\nThe_Newsroom = BBCRegularPrograms('p016tklr')\nNewshour = BBCRegularPrograms('p002vsnk')\nWorld_Business_Report = BBCRegularPrograms('p00fvhj7')\nThe_Real_Story = BBCRegularPrograms('p02dbd4m')\n\ndef printError(*args):\n    CRED = '\\033[91m'\n    CEND = '\\033[0m'\n    print(CRED, *args, CEND, sep='')\n\n\nlinks = []\nfor target in Programs.list_objects():\n    page_html = session.get(target.program_link)\n    tree = etree.HTML(page_html.text)\n    title = tree.findtext('.//title')\n    first_program_link = tree.xpath(target.first_audio_xpath)[0].attrib['href']\n    second_program_link = tree.xpath(target.second_audio_xpath)[0].attrib['href']\n    if not first_program_link.startswith('https://'):\n        first_program_link = f'https://www.bbc.co.uk{first_program_link}'\n    if not second_program_link.startswith('https://'):\n        second_program_link = f'https://www.bbc.co.uk{second_program_link}'\n    middle_title = title.split(' - ')[1].strip()\n    links.append(Link(first_program_link, saving_dir / middle_title))\n    links.append(Link(second_program_link, saving_dir / middle_title))\n\n\ndef dl_link(link):\n    url = link.url\n    saving_path = link.saving_path\n    if (got := r.get(url)) is not None:\n        got = got.decode()\n        if got in ['downloaded', 'handling']:\n            print(f'{url} has already been downloaded')\n    else:\n        r.set(url, 'handling')  # write-lock\n        # direct yt-dlp call doesn't give you extra info\n        # # os.system(f'cd ~/Music/bbc; proxychains yt-dlp \"{latest_program_url}\"')\n        # p = Popen(shlex.split(f'proxychains yt-dlp \"{latest_program_url}\"'),\n        #           cwd=saving_dir,\n        #           stdout=PIPE, stderr=PIPE)\n        # out, err = p.communicate()\n        # if len(err) != 0:\n        #   pass\n        # else:\n        #   pass # insert to db\n        saving_path.mkdir(parents=True, exist_ok=True)\n        ydl = yt_dlp.YoutubeDL({'paths': {'home': str(saving_path)}})\n        try:\n            info = ydl.extract_info(url)\n            if info is not None:\n                r.set(url, 'downloaded')\n            else: # empty file\n                printError(info)\n                r.set(url, 'failed')\n        except Exception as e:\n            printError(e)\n            r.set(url, 'failed')\n\nimport multiprocessing as mp\n\npool = mp.Pool(processes=6)\nres = pool.map(dl_link, links)\n\n\nfor pod_subdir in saving_dir.glob('*'):\n    if pod_subdir.is_dir():\n        try:\n            list_of_files = pod_subdir.glob('*')\n            latest_path = max(list_of_files, key=lambda p: p.stat().st_ctime)\n            sym_src_path = pod_subdir / latest_path.name\n            sym_dst_path = saving_dir / f'{pod_subdir}{latest_path.suffix}'  # `suffix` itself has '.'\n            # os.symlink(sym_src_path, sym_dst_path) # does not support overwrite\n            os.system(f'ln -sf \"{sym_src_path}\" \"{sym_dst_path}\"')\n        except Exception as e:\n            printError(e)\n    else:\n        if not pod_subdir.is_symlink():\n            printError(f'we should NOT have files in subdir: {pod_subdir}')\n            # shutil.move(pod_subdir, saving_dir / pod_subdir.name.split(',')[0])\n\n# delete old files\nos.system(f'find {bbcroot} -mtime +7 -type f -delete')\n# if complains about already downloaded while it's not, then delete the key in redis\n

\n","createdAt":"2023-08-28 15:11:45.758401","updatedAt":"2024-03-17 13:05:13.897419","replyToPostNumber":null,"replyCount":0,"likeCount":1,"wordCount":554,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":677,"username":"Aftersun","name":null}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":1047,"username":"anonymous_coward_old","name":"Anonymous Coward Old","avatarUrl":"/uploads/image/43/32/4332638c11248b8ff07033c11de0759a55205facfbec85e14458245a91991faf.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":10178,"postNumber":3,"raw":"Politics related:\nAnalyse Asia with Bernard Leong\nEconomic Update\nNCUSCR Interiews\nDavid Harvey's Anti-Capitalist Chronicles\n\nMiscellaneous:\nEconTalk\nHidden Brain\nMerriam-Webster's word of the Day\nNature Podcast\nPhilosophize This!\nSticky Notes:The Classical Music Podcast\n响声播客\nTED Talks Daily","cooked":"

Politics related:
\nAnalyse Asia with Bernard Leong
\nEconomic Update
\nNCUSCR Interiews
\nDavid Harvey's Anti-Capitalist Chronicles

Miscellaneous:
\nEconTalk
\nHidden Brain
\nMerriam-Webster's word of the Day
\nNature Podcast
\nPhilosophize This!
\nSticky Notes:The Classical Music Podcast
\n响声播客
\nTED Talks Daily

\n","createdAt":"2023-08-29 00:03:47.48549","updatedAt":"2023-08-29 08:06:31.204183","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":40,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":5,"publicVersion":5,"deletedAt":null,"isAnonymous":false,"user":{"id":1079,"username":"Bohm","name":null,"avatarUrl":"/uploads/image/86/5e/865eaf7f41f2f87cb3aa40d80c0b93f467a7d2332c6fbbf347578e90b740614b.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}}],"hasMore":false,"lastReadPostNumber":3,"hasUrlPostNumber":true}