[owncloud-devel] php-fpm hanging: segfault, SIGSEGV - CPUs 100%

Martin crysman Zahradník crysman at seznam.cz
Thu Jul 21 11:39:40 GMT 2016


Hello,

today owncloud webserver got too slow to even log-in. I did SSH and
checked htop (top) - 100% CPU, load average around 23 (!)

OK, that is bad.

So I checked some log files and found this:

⚡ cat /var/log/messages | grep -i err | tail
Jul 21 13:28:32 cloud kernel: [ 5035.723242] php5-fpm[16002]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:28:45 cloud kernel: [ 5048.958776] php5-fpm[16032]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:28:47 cloud kernel: [ 5050.946225] php5-fpm[16033]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:28:51 cloud kernel: [ 5055.286449] php5-fpm[16034]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:28:56 cloud kernel: [ 5059.719135] php5-fpm[16062]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:29:09 cloud kernel: [ 5073.420829] php5-fpm[16102]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:29:15 cloud kernel: [ 5079.317363] php5-fpm[16114]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:29:24 cloud kernel: [ 5087.786983] php5-fpm[16145]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:29:28 cloud kernel: [ 5091.781061] php5-fpm[16144]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]
Jul 21 13:29:28 cloud kernel: [ 5091.867168] php5-fpm[16146]: segfault
at 7fff795caed8 ip 0000000000690b2a sp 00007fff795cae90 error 6 in
php5-fpm[400000+85c000]


And this:
⚡ cat /var/log/php5-fpm.log | grep -i warn | tail
[21-Jul-2016 13:30:19] WARNING: [pool owncloud.somedomain.here] child
16267 exited on signal 11 (SIGSEGV) after 174.181309 seconds from start
[21-Jul-2016 13:30:19] WARNING: [pool owncloud.somedomain.here] child
16261 exited on signal 11 (SIGSEGV) after 175.186522 seconds from start
[21-Jul-2016 13:30:20] WARNING: [pool owncloud.somedomain.here] child
16266 exited on signal 11 (SIGSEGV) after 175.229058 seconds from start
[21-Jul-2016 13:30:43] WARNING: [pool owncloud.somedomain.here] child
16303 exited on signal 11 (SIGSEGV) after 177.555848 seconds from start
[21-Jul-2016 13:31:04] WARNING: [pool owncloud.somedomain.here] child
16383 exited on signal 11 (SIGSEGV) after 175.119034 seconds from start
[21-Jul-2016 13:31:05] WARNING: [pool owncloud.somedomain.here] child
16377 exited on signal 11 (SIGSEGV) after 179.319993 seconds from start
[21-Jul-2016 13:31:09] WARNING: [pool owncloud.somedomain.here] child
16384 exited on signal 11 (SIGSEGV) after 173.453260 seconds from start
[21-Jul-2016 13:31:11] WARNING: [pool owncloud.somedomain.here] child
16385 exited on signal 11 (SIGSEGV) after 173.200730 seconds from start
[21-Jul-2016 13:31:15] WARNING: [pool owncloud.somedomain.here] child
16428 exited on signal 11 (SIGSEGV) after 168.492796 seconds from start
[21-Jul-2016 13:31:17] WARNING: [pool owncloud.somedomain.here] child
16426 exited on signal 11 (SIGSEGV) after 171.079030 seconds from start


And this:
[21-Jul-2016 13:28:56] WARNING: [pool owncloud.somedomain.here] child
16062 exited on signal 11 (SIGSEGV) after 173.474043 seconds from start
[21-Jul-2016 13:29:09] WARNING: [pool owncloud.somedomain.here] child
16102 exited on signal 11 (SIGSEGV) after 171.912835 seconds from start
[21-Jul-2016 13:29:15] WARNING: [pool owncloud.somedomain.here] child
16114 exited on signal 11 (SIGSEGV) after 173.574837 seconds from start
[21-Jul-2016 13:29:24] WARNING: [pool owncloud.somedomain.here] child
16145 exited on signal 11 (SIGSEGV) after 171.567673 seconds from start
[21-Jul-2016 13:29:28] WARNING: [pool owncloud.somedomain.here] child
16144 exited on signal 11 (SIGSEGV) after 175.886644 seconds from start
[21-Jul-2016 13:29:28] WARNING: [pool owncloud.somedomain.here] child
16146 exited on signal 11 (SIGSEGV) after 175.222437 seconds from start
[21-Jul-2016 13:30:19] WARNING: [pool owncloud.somedomain.here] child
16267 exited on signal 11 (SIGSEGV) after 174.181309 seconds from start
[21-Jul-2016 13:30:19] WARNING: [pool owncloud.somedomain.here] child
16261 exited on signal 11 (SIGSEGV) after 175.186522 seconds from start
[21-Jul-2016 13:30:20] WARNING: [pool owncloud.somedomain.here] child
16266 exited on signal 11 (SIGSEGV) after 175.229058 seconds from start
[21-Jul-2016 13:30:43] WARNING: [pool owncloud.somedomain.here] child
16303 exited on signal 11 (SIGSEGV) after 177.555848 seconds from start

Here is top output:
  PID USER      PR  NI  VIRT  RES  SHR S  %CPU %MEM    TIME+ 
COMMAND                                                                                                                         

 3356 mysql     20   0 4589m 357m  15m S  93,6 14,9  54:31.44
mysqld                                                                                                                          

16884 owncloud  10 -10  375m  37m  25m S  24,9  1,6   0:00.75
php5-fpm                                                                                                                        

16732 owncloud  10 -10  390m  51m  24m S  16,9  2,2   0:10.47
php5-fpm                                                                                                                        

16618 owncloud  10 -10  400m  62m  25m S  16,3  2,6   0:17.30
php5-fpm                                                                                                                        

16742 owncloud  10 -10  391m  56m  30m S  15,9  2,4   0:09.20
php5-fpm                                                                                                                        

16616 owncloud  10 -10  402m  67m  30m R  15,6  2,8   0:17.17
php5-fpm                                                                                                                        

16543 owncloud  10 -10  410m  71m  24m S  15,3  3,0   0:25.70
php5-fpm                                                                                                                        

16617 owncloud  10 -10  399m  62m  25m S  14,6  2,6   0:17.61
php5-fpm                                                                                                                        

16672 owncloud  10 -10  395m  56m  24m S  14,3  2,3   0:13.62
php5-fpm                                                                                                                        

16733 owncloud  10 -10  390m  51m  24m S  14,3  2,2   0:10.24
php5-fpm                                                                                                                        

16879 owncloud  10 -10  377m  38m  24m S  14,3  1,6   0:01.59
php5-fpm                                                                                                                        

16790 owncloud  10 -10  383m  45m  25m S  13,9  1,9   0:06.02
php5-fpm                                                                                                                        

16791 owncloud  10 -10  384m  46m  25m S  13,9  1,9   0:06.10
php5-fpm                                                                                                                        

16830 owncloud  10 -10  382m  43m  24m S  13,9  1,8   0:04.67
php5-fpm                                                                                                                        

16789 owncloud  10 -10  386m  48m  25m S  13,6  2,0   0:07.85
php5-fpm                                                                                                                        

16880 owncloud  10 -10  375m  36m  24m S  13,3  1,5   0:01.02
php5-fpm                                                                                                                        

16740 owncloud  10 -10  389m  50m  24m S  12,9  2,1   0:09.45
php5-fpm                                                                                                                        

16741 owncloud  10 -10  388m  50m  24m S  12,9  2,1   0:09.08
php5-fpm                                                                                                                        

16831 owncloud  10 -10  381m  42m  24m R  12,9  1,8   0:04.30
php5-fpm                                                                                                                        

16836 owncloud  10 -10  379m  40m  24m S  12,9  1,7   0:02.81
php5-fpm                                                                                                                        

16739 owncloud  10 -10  390m  51m  24m S  12,3  2,2   0:10.11 php5-fpm


Where the problem might be, please? *What shall I do?*

Additional debug info:
PHP 5.5.36

mysql  Ver 15.1 Distrib 10.0.25-MariaDB

owncloud:
  - version: 8.2.5.2
  - versionstring: 8.2.5

Apache/2.4.10 (Debian)

OS:
  Description:    Debian GNU/Linux 7.11 (wheezy)
  Release:    7.11


Thanks a lot
McZ

-- 
 
/Martin crysman Zahradník/
/www:/ crysmanovo.blogspot.com <http://crysmanovo.blogspot.com>
/e-mail:/ crysman at seznam.cz
/jabber:/ crysman at jabber.org
/Google talk/hangout:/ crysmanovo at gmail.com
/facebook:/ no way!
/Skype:/ no way! using Ekiga - SIP:crysman at ekiga.net
running GNU/Linux Xubuntu
Jak kupovat zodpovědně vejce (nejen) o Velikonocích?
<http://crysmanovo.blogspot.com/2016/03/jak-kupovat-zodpovedne-vejce-nejen-o.html>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.owncloud.org/pipermail/devel/attachments/20160721/bb59d715/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 473 bytes
Desc: OpenPGP digital signature
URL: <http://mailman.owncloud.org/pipermail/devel/attachments/20160721/bb59d715/attachment-0001.sig>


More information about the Devel mailing list