I do have a family, and obviously I spend as much time as I can with them. Though even when I'm with my family, my mind tends to drift toward baseball.
The most terrifying thing I can think of is being alone - and I mean utterly alone, like no one else in the world alone - at night. That's the nucleus of the first story in my collection and it's also where the title came from for the book.