How about setting up one Checkmk server in your cloud, and one Checkmk server per physical location. Then, using distributed monitoring, you can manage them centrally from your Cloud.
Maybe also keep an eye an the upcoming Checkmk Push agent configuration, that may lend itself well to hybrid cloud setups. Not sure here myself if licensing will allow it, etc. nonetheless, keep eye out.