Bug #4735
closedPostgresql (8.3, on SLES11) database grows apparently without limits (9.1 too?)
Description
On Postgresql 8.3 (the versio of SLES11), the database seems to be always growing, without means to constraint it.
It appears the indexes are the culprit (for a 38 GB table, there are 20 GB extra indexes), as they bloat very fast.
bloating is caused by deletion of rows (which we do often), and vacuum full (which we don't do)
Apparently, there need to be specific tuning in the vacuum strategy on 8.3 to prevent bloating ( see http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=11&ved=0CCcQFjAAOAo&url=http%3A%2F%2Fwww.nws.noaa.gov%2Foh%2Fhrl%2Fhseb%2FpostgreSQL%2FVACUUM.pdf&ei=QGs-U8aVDc_y7AbAtYCwDQ&usg=AFQjCNEOsYpQ3a5rbSi7CIkbxGf4WvsFNw&sig2=bRCkHteUw0MslhatY2mvug&bvm=bv.64125504,d.ZGU&cad=rja ), with the general recommendation to upgrade to 8.4, as it is more easy
Bloat can be mesured with the following script:
http://wiki.postgresql.org/wiki/Show_database_bloat
An easy step can be to reindex the index, to clean them.
More info can also be found here:
http://gkoenig.wordpress.com/2009/11/24/postgres-and-bloated-table/
http://www.postgresql.org/docs/8.3/static/routine-vacuuming.html
It seems version 9.x are completely safe of this problem, and 8.4 suffers from it, but to a much lesser extent
It seem that we have the same behavior with postgresql 9.1
We have seen 25GB of index for 66GB of data on postgresql 9.1
Updated by Vincent MEMBRÉ over 10 years ago
- Subject changed from Postgresql database grows apparently without limits to Postgresql (8.3, on SLES11) database grows apparently without limits
Updated by Vincent MEMBRÉ over 10 years ago
We added in the FAQ, how to clean the indexes on Rudder here: https://www.rudder-project.org/site/documentation/faq/#the_postgresql_database_seems_to_be_using_too_much_space_how_can_i_reclaim_some_of_it
Updated by Vincent MEMBRÉ over 10 years ago
- Target version changed from 2.6.13 to 2.6.14
Updated by Jonathan CLARKE over 10 years ago
- Target version changed from 2.6.14 to 2.6.16
Updated by Jonathan CLARKE over 10 years ago
- Target version changed from 2.6.16 to 2.6.17
Updated by Nicolas PERRON over 10 years ago
- Target version changed from 2.6.17 to 2.6.18
Updated by Benoît PECCATTE about 10 years ago
- Subject changed from Postgresql (8.3, on SLES11) database grows apparently without limits to Postgresql (8.3, on SLES11) database grows apparently without limits (9.1 too?)
- Description updated (diff)
It seem that we have the same behavior with postgresql 9.1
We have seen 25GB of index for 66GB of data on postgresql 9.1
Updated by Matthieu CERDA about 10 years ago
- Target version changed from 2.6.18 to 2.6.19
Updated by Vincent MEMBRÉ about 10 years ago
- Target version changed from 2.6.19 to 2.6.20
Updated by François ARMAND almost 10 years ago
- Target version changed from 2.6.20 to 2.10.10
Updated by Vincent MEMBRÉ almost 10 years ago
- Target version changed from 2.10.10 to 2.10.11
Updated by Vincent MEMBRÉ over 9 years ago
- Target version changed from 2.10.11 to 2.10.12
Updated by Vincent MEMBRÉ over 9 years ago
- Target version changed from 2.10.12 to 2.10.13
Updated by Vincent MEMBRÉ over 9 years ago
- Target version changed from 2.10.13 to 2.10.14
Updated by Vincent MEMBRÉ over 9 years ago
- Target version changed from 2.10.14 to 2.10.15
Updated by Vincent MEMBRÉ over 9 years ago
- Target version changed from 2.10.15 to 2.10.16
Updated by Vincent MEMBRÉ over 9 years ago
- Target version changed from 2.10.16 to 2.10.17
Updated by Vincent MEMBRÉ about 9 years ago
- Target version changed from 2.10.17 to 2.10.18
Updated by Vincent MEMBRÉ about 9 years ago
- Target version changed from 2.10.18 to 2.10.19
Updated by Vincent MEMBRÉ about 9 years ago
- Target version changed from 2.10.19 to 2.10.20
Updated by Vincent MEMBRÉ almost 9 years ago
- Target version changed from 2.10.20 to 277
Updated by Vincent MEMBRÉ almost 9 years ago
- Target version changed from 277 to 2.11.18
Updated by Vincent MEMBRÉ almost 9 years ago
- Target version changed from 2.11.18 to 2.11.19
Updated by Vincent MEMBRÉ over 8 years ago
- Target version changed from 2.11.19 to 2.11.20
Updated by Vincent MEMBRÉ over 8 years ago
- Target version changed from 2.11.20 to 2.11.21
Updated by Vincent MEMBRÉ over 8 years ago
- Target version changed from 2.11.21 to 2.11.22
Updated by Vincent MEMBRÉ over 8 years ago
- Target version changed from 2.11.22 to 2.11.23
Updated by Vincent MEMBRÉ over 8 years ago
- Target version changed from 2.11.23 to 2.11.24
Updated by Vincent MEMBRÉ about 8 years ago
- Target version changed from 2.11.24 to 308
Updated by Vincent MEMBRÉ about 8 years ago
- Target version changed from 308 to 3.1.14
Updated by Vincent MEMBRÉ about 8 years ago
- Target version changed from 3.1.14 to 3.1.15
Updated by Vincent MEMBRÉ about 8 years ago
- Target version changed from 3.1.15 to 3.1.16
Updated by Vincent MEMBRÉ about 8 years ago
- Target version changed from 3.1.16 to 3.1.17
Updated by François ARMAND about 8 years ago
- Status changed from New to Rejected
This version of Postgres isn't supported since before Rudder 2.11, which isn't supported anymore either. Closing this ticket because it doesn't happen with a more revent version of Postgres.