If you're driving towards Yosemite on Highway 120, the Hotel Charlotte will be on your left as you pass through downtown Groveland. Since Groveland's downtown is only a few blocks long, you'd have to make a concerted effort to miss it.
For a larger-scale map showing where Groveland is in relation to Yosemite, see the Yosemite Lodging main page.