You could maybe have a small piece somewhere creating drag. If you are sure it's not that, it could be mass. Make sure that collisions are disabled on all moving parts, as that can cause roll too.
Another common mistake is airfoil of the vertical stabilizer or rudder not being symmetric.

Mirror it if possible
Sometimes drag unbalances won't show in drag test
Make sure all controlling surfaces are not angled