How do I handle feelings for someone else?

I met this man at a coffee shop weeks ago & we just clicked, like really clicked — started talking about books, life, stuff nobody in my marriage has cared to ask in years. My husband don’t say much no more, it’s all quiet dinners & separate rooms. This other man laughs at my jokes, remembers the little things, looks at me like I’m still someone worth seeing. Last night he held my hand & I felt something in my chest like I’d been holding my breath for ten years & finally let it go. But then guilt hit me like a truck. I didn’t think I could feel this way again, not really, but now I don’t know what to do. I keep telling myself I made a vow but it’s been years of walking on eggshells, trying to fix what he don’t even see is broken. My mama always said walk away before you cheat cause once you cross that line there ain’t no coming back but I’m tired of being lonely in a marriage that don’t feel like one & part of me wonders if wanting more is so wrong