Don't forget the Sand Bar. That place is NOISEY! If you can get a quiet slip it could be worth while.
I know how you feel about 50 miles each way when you want to go somewhere.
A while ago, another RO was asking about boating up north from here vs. long island, and I had to say there is no comparison. LI has much better boating available. While there are many more boaters, the destinations and the environment are better if you can find the time to travel when everyone else is busy elsewhere.
As you are probably aware, traveling on the weekends on the Hudson can be a chore if you are a trawler given all of the faster traffic.