Newbern fishing

I'm coming down to Newbern this Sunday 10/21 for a couple nights and wondering where some good places to fish might be. I'll be staying in a hotel that borders a waterway, I'm guessing Neuse River?. It's a couple blocks from Union Point park.

Does anyone have any suggestions for good places in that general area, and what people are catching and good baits to use? Thanks!

Peter