OMG this is the perfect setup for a soil thread! And yet... nothing!!
In general, ALWAYS start with (1) soil and (2) water. The follow-up being naturally (3) sun.
Most places I know in the US (with the possible exception of the Midwest) have crappy soil. If you live in a residential area there is a good chance that you have crappy soil compounded by poor drainage, impaction from construction, invasive roots, and who knows what else that is battling your garden plans. Assuming you have decent drainage, it is critical that you prep your soil and maintain it. If you want a killer garden for at least 10 years, rototill the soil and blend in soil amendments to keep the soil open as much as possible. It varies somewhat based on where you live and your current conditions, but if you reach down and your garden soil feels more like mud or dirt... and not a good bonsai soil blend... you can do better.
Make sure your water doesn't suck. Some part of the country it isn't an issue. In California, for all the talk about 'environmental awareness', our water is almost poison for plants. My water out of the tap is 8.5 pH. Junipers would prefer it to be 5.0. If you want an amazing garden and have to rely AT ALL on irrigation, make sure you know your water chemistry, and be prepared to correct it as necessary.
My final garden point is sun. Not just sun today... but sun tomorrow and sun throughout the year. Put your tall plants / tall trees to the north of your garden or lot - so that they don't shade out your other plants. If possible, put your sun sensitive plants in positions where they will get full sun in the winter, but may get dappled sun or partial shade in the heat of the summer. Plan for changing seasons. My camellias get zero sun during the summer heat... but are in sunny locations at other times of the year.
Think like a garden.