Southeast of Bagh-i-Jinnah on Race Course Rd, the cool, green Race Course Park is the place to catch a polo game. It's also good for a stroll or jog - there's less human traffic on weekdays (late afternoons can get busy, though).
