In case this will help anyone (at least with a quest 2 and virtual desktop). I originally felt like no matter how much i adjusted my play space that for some reason I just could never avoid walls even when i was clearly stepping to the side.

You have to move your hands almost as much as you move your head. If your hands remain somewhat stationary you'll almost always hit the walls even when your head is clearly dodging the wall.