I always take mine off and clean from the action end. I clean the brake seperately - sometimes just by dunking it in Shooter Choice and wiping it down.
If using a cotton patch it will expand and stick in the holes of the brake if you try to clean with it on.
I also like to clean the threads and the area around the crown and cannot do that with the brake on.
i have never taken the brake of off my Mcbros LBR .50 BMG yet it still shoots great.i did not order the tool for taking the break of when i order the gun.for the money you would have thought they would give you a tool.or at least told me about it thanks,keith