Yes it would change the taste. Less sweetness so would seem drier, more bitter, less mouthfeel/body. Maybe more boozy tasting if you just stick to your usual recipe because you will have more alcohol.
Any sugar added (dextrose or glucose, assuming this is at bottling) will turn into alcohol so they will be roughly the same 'carb".
If you're gluten/barley/carb sensitive then fair enough, if you're just trying to drink low carb for your health I would do some more research - AFAIK the carbs make up a small amount of energy in beer, it's mostly the alcohol that will make you fat.