#11611 add monitoring for dnf countme
Opened 5 months ago by mattdm. Modified 4 days ago

https://data-analysis.fedoraproject.org/csv-reports/countme/

Hasn't updated in two weeks. It should update every Thursday. Please add some monitoring to check. The file date should be sufficient -- but looking at the week of the last entry in totals.db with sqlite3 would be even better.


Metadata Update from @phsmoura:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: high-gain, medium-trouble

5 months ago

Metadata Update from @smooge:
- Issue assigned to smooge

5 months ago

Looking at the directories, it looks like someone is trying to fix the backlog of data, but I am not sure. There is also a very long running process

countme  1707020  0.0  0.0  12852  2376 pts/0    S+   Sep24   0:07 /bin/sh -e ./mirrors-countme/scripts/countme-regenerate-dbs.sh

Not sure if that is a one and done script which should hve ended a long time ago or one which is always on

Metadata Update from @smooge:
- Issue untagged with: high-gain, medium-trouble
- Issue assigned to nphilipp (was: smooge)
- Issue priority set to: Needs Review (was: Waiting on Assignee)

5 months ago

Metadata Update from @smooge:
- Issue priority set to: Waiting on Assignee (was: Needs Review)

5 months ago

Metadata Update from @smooge:
- Issue tagged with: high-gain, medium-trouble, ops

5 months ago

BTW, this is fixed, but there may be a gap we are still investigating.

The long running script is the import of all the old data for the new unique IP feature. It's importing into *-new.db files, so shouldn't affect any of the production processes.

So, whats left here? a nagios check on the file age of something in that dir? Should it alert after a day? more?
Or is there any better way to monitor this and confirm it's still working ?

Metadata Update from @zlopez:
- Issue assigned to dkirwan (was: nphilipp)

3 months ago

Hey @james any thoughts here on how we could monitor that things are working right?

For the output, monitoring the file timestamps on: https://data-analysis.fedoraproject.org/csv-reports/countme/

...should be a start, although if we can get it to do more that'd be nice. Looking into adding things to Fedora zabbix.

Login to comment on this ticket.

Metadata
Boards 1
ops Status: Backlog