I'd be interested in hearing what's the type of conflict you are getting. As far as I remembere it should be ok cluster-wise, config of course might have breaking changes and it might not run.
There might be some issues with Ingress controllers and other stuff but I don't really remember conflicts with the garden-system namespace.
If you have some errors or ideas, we can try to see if that can be solved.