Let us go to where the sidewalk ends. They will follow the arrows to where the sidewalk ends, leaving the asphalt flowers and where the road bends and turns.
I feel like this is talking about going somewhere where life is not ruled by time, where you need to be and the modern world that we live it. They want to go to where the children are, in a world that is free and beautiful. You notice the beauty and your surroundings where the sidewalk ends, but when the sidewalk begins you must pay attention to society and the asphalt and all of the sophistication that comes along with being an adult. Going back to where the sidewalk ends seems to me like the speaker wants their childhood back, the innocence that childhood holds.