Until recently the only lower end digital camera with a built-in GPS that I was aware of is the Ricoh 500SE, which is still rather expensive. But there is now a less expensive alternative. I've acquired a Nikon P6000 which has a built-in GPS. I've just taken it along on a trip to Las Vegas and other destinations.
The camera embeds WGS84 lon lat coordinates in the image files which you can upload to MyPictureTown, which recognizes the embedded coordinates and displays the locations in Google Maps and allows you to click on a marker and see the picture(s) at that location and vice versa. I managed to find enough satellites with strong signals over southern Utah to take a few pictures with embedded GPS coordinates.