One thing I miss is this easy navigation concept that I experience on video games, namely the Grand Theft Auto series.

When you pick a POI destination you want to go to by using "Take me There", you should get a glowing arrow that knows your compass bearing on your camera view and points you towards the direction you need to look/walk to in real-time.

If the POI is not currently on the screen (e.g. it's behind you) the arrow should still be visible somewhere on the borders of the screen pointing in the direction of the POI.

Here's one example of this AR interaction done by Presselite (jump to 0:50 in the timeline):

http://www.liquida.com/video/a3745634c/london-cycle-hire-augmented-...

If you add this someday, Layar would be a much better tool for getting directions than Google Maps even!

-Carlos