We pulled our 7' fence out years ago, and yes deer used to come up at night. (Though generations of our dogs have always spent a lot of the night barking at the coyotes across the canyon). But last fall, with these new dogs, the deer didn't come up. They weren't drinking from the water bucket we kept filled for them in the garden, and I had to shovel up the apples from beneath the apple tree, which is something I've never had to do before. We will see, though. The dogs do sleep more during the day than they did when they were puppies, and maybe the deer have been developing new stealth skills in preparation for this summer.Even a 3' fence should keep the bunnies and dogs out. That is what I have and it is worth it.
It takes a 7' fence to keep the deer out! I spray my potato plants with Liquid Fence. Deer don't seem to eat pepper, tomato, onion, carrot or squash plants, in my experience.
Dogs are very helpful against rabbits. Deer do most of their damage at night when dogs are inside sleeping
I wish you luck. I love eating vegies from my garden.