Why can I cheat in Greece?

Got back home last week after my annual 2-week trip to the Greek island of Kefalonia. Over the past few years, I've noticed something weird about the food there.

What that is begins with my discovery a couple of years ago that, in America, certain foods raise my fasting blood glucose level. That is, if eat those foods, then the next morning, my blood glucose will be elevated.

If I eat those foods for three or more days in a row, my weight begins to rise, and I begin to put on fat around my waist. These foods include, not surprisingly, bread and sweets. 

Well, on Kefalonia, the bread comes fresh from village bread shops called "fourna" (ovens). When you walk into one of these places when they're just pulling a fresh batch out of the oven, the aroma is intoxicating. Also, some of these places make Greek desserts like baklava and melomakarna.

Anyway, during my visits over the past three years, I've taken to eating about a loaf of bread a day plus multiple of the sweets. I do this for the duration of the trip. This time, I was on the island for 14 days. I ate A LOT of bread and sweets.

Yet every time I come back home, I not only have failed to put on fat, I have actually lost fat. For example, this year I came back weighing 1 pound less than what I weighed the morning I left for the trip, with 1/2" off of my waist.

What gives? I can assure you that exercise is not the answer. Some trips I do exercise; other I don't. It doesn't seem to matter.

Also, I don't think it's the answer my sister proposed: "Maybe you're just happier there, so you digest better." This trip, I was more stressed than usual. First, I terribly missed my 2-year-old daughter. Second, I got a little sick of Greece toward the end (as I discuss in my personal blog).

So my simple question is the following: Why does eating bread and sweets in America make me fat, but in Greece it doesn't? Any ideas?