Near the pier: sandys beach shack (located below Dukes) is pretty chill, tons of beer and drink choices plus food is ok. Great place to hang out and people watch. Longboards on main street opposite pier has happy hours and inside outside places to hang. There are plenty of other bars up and down…
I personally love Sandy's right under the pier. Good spot for a sunset dinner. I think they still have a small farmers market type thing near the pier on Friday. You can rent bikes and ride up to Bolsa Chica, there's some newer restaurants up there right on the beach. Check out the Surfing Museum while you're downtown.