biubiu 发表于 2018-4-2 11:37:32

使用关关采集遇到的一个问题,这应该是那一块的问题?

本帖最后由 biubiu 于 2018-4-2 17:52 编辑

用的是关关采集,然后远程采到另一个服务器数据库,网站的目录是用Samba共享过来的

之前采了一天没问题,在昨天晚上开始出现这个错误

无法从传输连接中读取数据: 远程主机强迫关闭了一个现有的连接

不知道这个是网站数据库的问题,还是采集源站把我IPban?

使用关关的测试没问题,今天早上从8点采集到11点时候,又发现进度不动,日志出现这个错误

日志出现这个错误后,只有强制关闭关关后,才能正常采集



使用的是mysql5.5,php5.2,apache2.2,杰奇1.7,关关5.6


具体错误提示和代码如下,在中午11点的时候,出现过一次问题,但是数据库日志那个时间好像是空的


http://imger.top/images/2018/04/02/QQ20180402111951.png
http://imger.top/images/2018/04/02/QQ20180402112529.png

1804028:13:50 Plugin 'InnoDB' is disabled.
1804028:13:50 Plugin 'FEDERATED' is disabled.
1804028:13:50 Server hostname (bind-address): '0.0.0.0'; port: 3306
1804028:13:50    - '0.0.0.0' resolves to '0.0.0.0';
1804028:13:50 Server socket created on IP: '0.0.0.0'.
1804028:13:51 Event Scheduler: Loaded 0 events
1804028:13:51 /usr/local/mysql/bin/mysqld: ready for connections.
Version: '5.5.56-log'socket: '/tmp/mysql.sock'port: 3306Source distribution
1804028:20:31 IP address '138.68.62.190' could not be resolved: Name or service not known
1804028:24:30 IP address '119.1.109.84' could not be resolved: Name or service not known
1804028:51:07 IP address '111.73.45.103' could not be resolved: Name or service not known
1804028:51:22 IP address '111.73.46.80' could not be resolved: Name or service not known
180402 10:29:38 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:39 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:41 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:42 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:46 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:47 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:56 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:50 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:51 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:54 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:56 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:58 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:29:59 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:30:00 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:30:01 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:30:02 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:30:03 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 10:30:04 IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
180402 13:43:47 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:43:57 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:44:10 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:44:18 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:44:31 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:44:41 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:44:54 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:45:05 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:45:15 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:45:25 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:45:35 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:45:50 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:45:58 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:46:04 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:46:09 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:46:25 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:46:28 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:46:29 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:46:46 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:46:48 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:46:59 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:47:18 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:47:30 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:47:40 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:47:54 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:48:02 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:48:03 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
180402 13:48:04 IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution

二暖的萌萌君 发表于 2018-4-2 11:37:33

这个错误日志表示mysql对ip地址进行dns解析,解决的办法就是修改my.cnf配置文件取消dns解析

Johnny12w 发表于 2018-4-2 11:46:17

这就是触及我知识的盲区了,不过 帮顶一下楼下解答

biubiu 发表于 2018-4-2 11:48:13

Johnny12w 发表于 2018-4-2 11:46
这就是触及我知识的盲区了,不过 帮顶一下楼下解答

yc006t其实我搜了下

但是这个关键词+关关,好像没有符合的

大多数结果都在说我看不懂的东西

★百晓通★ 发表于 2018-4-2 11:48:25

biubiu 发表于 2018-4-2 11:52:35

★百晓通★ 发表于 2018-4-2 11:48
目测是把你的ip给屏蔽了

但是可以开五个线程,采集三小时都没问题啊

★百晓通★ 发表于 2018-4-2 11:54:02

这小指 发表于 2018-4-2 12:04:56

biubiu 发表于 2018-4-2 12:30:56

这小指 发表于 2018-4-2 12:04
采得急。。会卦你IP啊。。正常吧。。

yc008t一天下来,只有三百不到

这速度应该挺慢了yc007t

biubiu 发表于 2018-4-2 17:07:05

yc016t有没有大佬把分领走
页: [1] 2
查看完整版本: 使用关关采集遇到的一个问题,这应该是那一块的问题?