database consitency

[PPisz]

Is there a way to check the consistency of the CS database? For some time now, no usage_job process has completed successfully, and I don't know why.

[DaanHoogland]

@PPisz , any errors in the usage.log?
The only related consistency problem I can think of is that a sequence may be out of order (destroy at the same time or before create of some entity)

[PPisz]

@DaanHoogland
We enabled sanity check and got this alert:

Error: Found 187 usage records with raw_usage > 24
Error: Found 68 Vm usage records which are created after Vm is destroyed

Is there any way to fix these errors?

[DaanHoogland]

the second one are an example of what I described above. fixing timestamps on the events and re-running the usage may resolve that. the first one I am not sure of but it sounds like there are too many usage records per day (24 hrs?)

[PPisz]

@DaanHoogland We can't seem to figure this out. Is it possible to find the query that generates this alert somewhere in the CS source code? This would make it easier for us to find and fix invalid records.

SELECT ce.* FROM cloud.usage_event ce JOIN (SELECT resource_id, MAX(created) AS destroy_date FROM cloud.usage_event WHERE type = 'VM.DESTROY' GROUP BY resource_id) AS de ON ce.resource_id = de.resource_id WHERE ce.created > de.destroy_date AND ce.type LIKE 'VM.%';

The example query returns nothing, but we're probably doing it wrong.

[DaanHoogland]

@PPisz , I do not understand your query. It seems you are looking for events on a resource after a DESTROY event, is that right?

maybe the part ce.created > de.destroy_date should be ce.created >= de.created?