Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit history

Commits on Dec 5, 2022

• 删除配置文件多余的逗号

  Boris-code

  committed
  e16c248

  Copy full SHA for e16c248

Commits on Nov 18, 2022

• 支持重新导入失败的item

  Boris-code

  committed
  13b751f

  Copy full SHA for 13b751f

Commits on Oct 31, 2022

• 完善文档

  Boris-code

  committed
  cab2096

  Copy full SHA for cab2096

Commits on Oct 30, 2022

• 默认获取任务数量为32条

  Boris-code

  committed
  f4e7ba8

  Copy full SHA for f4e7ba8

Commits on Oct 28, 2022

• 爬虫并发数默认1

  Boris-code

  committed
  4f14f8f

  Copy full SHA for 4f14f8f

Commits on Oct 25, 2022

• air spider 支持去重

  Boris-code

  committed
  051c2ae

  Copy full SHA for 051c2ae

Commits on Oct 17, 2022

• playwright 支持保存拦截的所有接口

  Boris-code

  committed
  41113fa

  Copy full SHA for 41113fa

• playwright 默认的wait_until=networkidle

  Boris-code

  committed
  ad292b3

  Copy full SHA for ad292b3

• 完善代码

  Boris-code

  committed
  55bfa4e

  Copy full SHA for 55bfa4e

Commits on Oct 14, 2022

• playwright 支持指定浏览器类型

  Boris-code

  committed
  0c0bfac

  Copy full SHA for 0c0bfac

Commits on Oct 13, 2022

• playwright 支持拦截方法

  Boris-code

  committed
  572b4bd

  Copy full SHA for 572b4bd

Commits on Sep 25, 2022

• playwright 的配置单独抽取出来

  Boris-code

  committed
  9ab0e1c

  Copy full SHA for 9ab0e1c

Commits on Sep 23, 2022

• playwright 支持storage_state

  Boris-code

  committed
  edcdbef

  Copy full SHA for edcdbef

Commits on Sep 20, 2022

• LOG_LEVEL 支持从环境变量里获取

  Boris-code

  committed
  26fcaa6

  Copy full SHA for 26fcaa6

Commits on Jul 31, 2022

• 1. request支持是否拼接绝对连接参数 2. 下载方法单独抽离出来，方便扩展

  Boris-code

  committed
  245bc93

  Copy full SHA for 245bc93

Commits on Jun 9, 2022

• AirSpider 支持设置内存任务队列最大缓存的任务数

  Boris-code

  committed
  63c6dcc

  Copy full SHA for 63c6dcc

Commits on Jun 7, 2022

• 修改爬虫并发数的默认值为32

  Boris-code

  committed
  56c289e

  Copy full SHA for 56c289e

• 浏览器渲染添加use_stealth_js开关

  Boris-code

  committed
  0c0069f

  Copy full SHA for 0c0069f

• Merge branch 'ShellMonster-dev' into develop

  Boris-code

  committed
  d982628

  Copy full SHA for d982628

• format code

  Boris-code

  committed
  e117a2b

  Copy full SHA for e117a2b

• 启动自动适配浏览器版本

  Boris-code

  committed
  4c4d8f9

  Copy full SHA for 4c4d8f9

Commits on May 18, 2022

• 支持飞书报警

  Boris-code

  committed
  da85aeb

  Copy full SHA for da85aeb

Commits on May 17, 2022

• 优化collector

  Boris-code

  committed
  f2afac2

  Copy full SHA for f2afac2

Commits on Apr 21, 2022

• 下载器抽取出来

  Boris-code

  committed
  db26be2

  Copy full SHA for db26be2

Commits on Apr 13, 2022

• 1.7.5-beta4

  Boris-code

  committed
  14b1c1e

  Copy full SHA for 14b1c1e

Commits on Mar 26, 2022

• 设置日志格式

  Boris-code

  committed
  d618dc1

  Copy full SHA for d618dc1

Commits on Mar 3, 2022

• 支持自动安装 selenium驱动

  Boris-code

  committed
  40745d5

  Copy full SHA for 40745d5

Commits on Dec 30, 2021

• 浏览器渲染模式支持拦截数据

  Boris-code

  committed
  2c940b2

  Copy full SHA for 2c940b2

Commits on Dec 17, 2021

• 添加访客用户池

  Boris-code

  committed
  d58c267

  Copy full SHA for d58c267

Commits on Aug 29, 2021

• 修复 item 获取 table_name的bug, request 支持获取代理及ua

  Boris-code

  committed
  a5de93d

  Copy full SHA for a5de93d

• 去重配置暴露到setting

  Boris-code

  committed
  469c1a1

  Copy full SHA for 469c1a1

Commits on Aug 17, 2021

• 数据入库失败 记录到redis

  Boris-code

  committed
  0429cd5

  Copy full SHA for 0429cd5

• 数据入库失败 自动重试

  Boris-code

  committed
  1b00eb3

  Copy full SHA for 1b00eb3

Commits on Aug 15, 2021

• auto_stop_when_spider_done参数改为keep_alive

  Boris-code

  committed
  21d1737

  Copy full SHA for 21d1737

Commits on Aug 12, 2021

• 打点添加注释

  Boris-code

  committed
  9dfaf33

  Copy full SHA for 9dfaf33