The Blackberry Inn, located under the blue balloon on the above satellite view, is just off Highway 120 in what passes for downtown Buck Meadows. Hamilton Station Loop is indeed part of a loop, so you have two chances to find the turnoff. Even if you're a daydreamy driver and you miss the western turnoff, you probably won't overlook the Yosemite Ridge Resort, the group of white buildings opposite the eastern turnoff, so you can turn there and backtrack the quarter mile or so to the Blackberry Inn. The orange-roofed buildings near the right edge of the map are the Yosemite Westgate Lodge and the Buck Meadows Restaurant; if you somehow miss the Yosemite Ridge Resort, you'll know you're in the area when you pass the Westgate.
Buck Meadows is about 13 miles (21 km) west of Yosemite's Big Oak Flat entrance and 10 miles (16 km) east of Groveland on Highway 120.