The concept of the light-cone[1] really frustrated my younger self (raised on heady expectations, warp drives and transporters). There might be a sentient race very close to us in time-space that we will never know because the light-cones will never meet.
[1] http://en.wikipedia.org/wiki/Light_cone