About local and global integrate

[liangbingzhao]

Thanks for your great job. I tried to train uni-controlnet on celebahq. Seperately, the local adapter and global adapter's results seem good, like following
local adapter:

global adapter:

But after integrate, the model generate such things:

Is there anything need to notice when doing the local global integration?