The closest thing to a college town in SF, the Inner Sunset offers a lot - including an elite public (graduate only) university - but no undergrads :)
With the Golden Gate Park adjoining on the north - in particular, the Cal Academy of Science, the de Young Museum, and the Botanical Garden are nearby - and the amazing Grand View Park to the south west, the neighborhood is well-equipped for outdoor fun.
Worker-owned Arizmendi Bakery is a local favorite. Ebisu sushi enjoys wide regard all over the bay area. Le Video has (by far!) the largest selection of movies this side of Pirate Bay - and speaking of sketchy internet sites, craigslist.org's nominal office is in the hood :)
Address: Inner Sunset, SF
Website: http://en.wikipedia.org/wiki/Sunset_District,_San_Francisco