I have to say I have experienced the same feeling. Once I feel like my mods are complete (obviously always subject to change) I think I'll have a sticker made to put inside the Jeep so I can check before trying to drive in underground parkings or whatever else might be restrictive on height lol. Don't follow me, I'm lost too! O|||||||O
As mentioned, with a hard top, you will see a tiny bit of extra lift with it off but, nothing really measureable. Now, take off your doors too and you will see a rise in height.
My top and doors are all off I'm going to measure before I reinstall them and after to see the difference. You have to figure the combined weight of everything is a couple hundred pounds.
I don't know if it's really higher, but I like the way mine handles with a soft top (or no top) vs. the hard top. Feels lighter, more flexible and less like a tank.