OK, in the meantime I found another mention of slate as a buffer on cichlid-forum.com. May be I am missing something.
At the moment I have granite, slate in the tank. I have taken out one strange rock I could not really identify (close to granite but a bit lighter). Will see if that makes a difference.
The mineral content in the water should not be an issue as I am adding RO only. Normally I remineralize this to KH 4 with RO additive. For last few changes I have added RO only and still got KH creeping up.
Anyway, it's not a big issue - easy to keep under control with water changes. I will play with taking some rocks out and see if I find the culprit.