Yep. I made the trip in reverse a couple of years ago. Northeast, MD is at the head of the Bay. We made the trip in a 38' Silverton (LIYC to the Sassafras River). Easy trip if the weather is good. Our first leg was from LIYC to Brielle, NJ because we got a late start and had mechanical issues. We were cruising at about 18 knts and could have easily made Atlantic City on available fuel that day if it were not for the problems. Second leg was Brielle to Cape May where were spent the night at South Jersey Marina (and dinner at the Lobster House!!). The run from LI to Cape May was all down outside. Running the ICW through NJ is slow and riddled with skinny water, bridges and NWZs so it should be avoided if at all possible. The third leg and final was Cape May to the Chesapeake Bay. The route wass via the Cape May Canal to the Delaware Bay then entering the C&D Canal into the Chesapeake Bay. This part of the trip needs proper planning because the run from Cape May to the western end of the C&D is devoid of services. Its imperative that you top off the tanks before starting. Also, the Delaware Bay must be avoided in late afternoon as it is famous for pop-up squalls and there are few, if any, decent places to find protection from the storm. You'll be doing this in reverse so you'll leave NE, MD with full tanks early in the day and can easily get to Cape May in a day or far less depending on speed.
What boat are you considering and who has it?