Just to make things a little more clear, here are some definitions for what things are called:
Router - a piece of hardware that runs router software. It determines where internet packets go, gives devices IP addresses using DHCP, and whole host of other cool stuff. A router can have physical connections only (ethernet, for example), or they are sold as combo units with WiFi, too.
Access Point - A WiFi access point broadcasts and receives wifi signals, but still needs a router to handle the who, what, where, and when.
I suggest keeping your current router (combo) if you're happy with the management of things. To get better WiFi, you can add additional Access Points. They should be wired directly to your router. You can leave the WiFi on on your current combo-router, and just add extra WiFi as close to your devices as possible.
If you have access to Unifi products, they are pretty solid, but you'll need to boot up their controller software on a computer to get things set up.
Grandstream makes good hardware, too, and you can get them set up by accessing them directly over your network (controller software built in).
Mikrotik is a great brand and they have inexpensive Access Points, and also Router/WiFi combos (I think the combos are called "hAP"). They are enthusiast level type stuff, and not really user friendly. They do have a default configuration that will get you up and running, though. Their WiFi products are slightly behind the times (WiFi 6 is about as far along as they've come at this point, but hey, I'm still on WiFi 5 and doing fine).
I really like Mikrotik, but you have to be their target audience to enjoy using them, I think. Just throwing that out there.