Project

General

Profile

Actions

Architecture #17927

open

search on event log is quite slow

Added by Nicolas CHARLES over 3 years ago. Updated 8 days ago.

Status:
New
Priority:
N/A
Assignee:
-
Category:
Performance and scalability
Target version:
Effort required:
Name check:
To do
Fix check:
To do
Regression:

Description

I'm having a lot of event logs in my system (130k) and when i do a search in eveng, it can take up to a minute

It is not waiting for the user to finish to type, so it does query with Pol, Poli, Polic and Policy - there should be a higher timeout

Then searching does 2 query:

SELECT count(*) from ( select eventtype, id, modificationid, principal, creationdate, causeid, severity, reason, data, UNNEST(xpath('string(//entry)',data))::text as filter from eventlog) as temp1 where temp1.filter like '%Policy%'

and

select eventtype, id, modificationid, principal, creationdate, causeid, severity, reason, data from ( select eventtype, id, modificationid, principal, creationdate, causeid, severity, reason, data, UNNEST(xpath('string(//entry)',data))::text as filter from eventlog) as temp1 where temp1.filter like '%Polic%' order by id desc offset 0 limit 25 

The count query could be smaller

SELECT count(*) from ( select id, UNNEST(xpath('string(//entry)',data))::text as filter from eventlog) as temp1 where temp1.filter like '%Policy%'

would return the same result, with less moving around of data

Actions #1

Updated by Vincent MEMBRÉ over 3 years ago

  • Target version changed from 6.0.8 to 6.0.9
Actions #2

Updated by Vincent MEMBRÉ over 3 years ago

  • Target version changed from 6.0.9 to 6.0.10
Actions #3

Updated by Vincent MEMBRÉ over 3 years ago

  • Target version changed from 6.0.10 to 798
Actions #4

Updated by Benoît PECCATTE almost 3 years ago

  • Target version changed from 798 to 6.1.14
Actions #5

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.14 to 6.1.15
Actions #6

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.15 to 6.1.16
Actions #7

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.16 to 6.1.17
Actions #8

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.17 to 6.1.18
Actions #9

Updated by Vincent MEMBRÉ over 2 years ago

  • Target version changed from 6.1.18 to 6.1.19
Actions #10

Updated by François ARMAND about 2 years ago

  • Tracker changed from Bug to Architecture
  • Priority deleted (0)
Actions #11

Updated by Vincent MEMBRÉ almost 2 years ago

  • Target version changed from 6.1.19 to 6.1.20
Actions #12

Updated by Vincent MEMBRÉ almost 2 years ago

  • Target version changed from 6.1.20 to 6.1.21
Actions #13

Updated by Vincent MEMBRÉ almost 2 years ago

  • Target version changed from 6.1.21 to old 6.1 issues to relocate
Actions #14

Updated by Alexis Mousset about 1 year ago

  • Target version changed from old 6.1 issues to relocate to 8.0.0~alpha1
Actions #15

Updated by Vincent MEMBRÉ 9 months ago

  • Target version changed from 8.0.0~alpha1 to 8.0.0~beta1
Actions #16

Updated by Alexis Mousset 8 months ago

  • Target version changed from 8.0.0~beta1 to 8.1.0~alpha1
Actions #17

Updated by Vincent MEMBRÉ 2 months ago

  • Target version changed from 8.1.0~alpha1 to 8.1.0~beta1
Actions #18

Updated by Vincent MEMBRÉ 25 days ago

  • Target version changed from 8.1.0~beta1 to 8.1.0~beta2
Actions #19

Updated by Vincent MEMBRÉ 8 days ago

  • Target version changed from 8.1.0~beta2 to 8.1.0~beta3
Actions

Also available in: Atom PDF