Hmm, I'd say make sure and use DDU, but I'm not sure if that can clean up NVIDIA once you have AMD on there.
So maybe check with Driver Fusion.
Other than that I can't find much about low fps in BF4 with your card, I'll keep looking..