The general recommendation is to not have rocks greater than golf ball-sized so that lawn grass roots have a place to grow. Trees and shrubs have similar guidelines.
Original article: https://www.reviewjournal.com/life/home-and-garden/remove-large-rocks-so-roots-have-a-place-to-grow-2608604/