All very valid points mjordan. Well thought out, but I'd like to include a small addition to your theory. If the universe is constantly expanding, the distance between any possible intelligent life and us is also probably growing.

Too bad, we need as little room as possible.

There has to be something else living out there and maybe in Area 51.