Hello Guys!
I want to use prometheus as a central metrics storage (aka push based metrics solution) with remote receive capability enabled and push metrics to this prometheus server through remote write api with prometheus agents from multiple kubernetes clusters. I’ve found that it’s supported configuration from official docs.
But I also found that remote-write-receiver capability of prometheus should be used only for low-volume use cases with caution. And it’s confusing. Is prometheus server strong enough to handle load from multiple prometheus agents? Which cases should be avoided when we enable remote receive capability?
It would be highly appreciated, if someone can share real experience with this setup in production. Thank you!