专题文章
时长:00:00更新时间:2020-11-27 14:24:21
前言;大家在做数据抓取的时候,经常遇到由于网络问题导致的程序保存,先前只是记录了错误内容,并对错误内容进行后期处理。原先的流程。def crawl_page(url): pass def log_error(url): pass url = ";";try: crawl_page(url)except: log_error(url)。改进后的流程。attempts = 0success = Falsewhile attempts <;3 and not success: try: crawl_page(url) success = True except: attempts += 1 if attempts == 3: break。
查看详情