Little Captains has the advantage of a concession, but also has crowds and a very small anchorage. Most boaters around here anchor off the north beach on Great Captains, which has a nice sandy bottomed bay, or off Shell Island. Forget Greenwich Cove, unless you are going during the week.
I'll take Huntington any day.