Litter travels on paws, on fur, and on the draught of a cat leaving a box at speed. You will not eliminate it. You can cut it by most of the way, and the fixes are ranked below by how much difference each one actually makes.
1. A mat that traps rather than one that wipes
This is the single biggest change, and most mats fail at it. A flat rubber sheet moves the problem two feet to the left: granules land on it, then get kicked off it.
What works is a two-layer mat. The top layer is a grid of holes that granules fall through. The bottom layer is sealed, so what falls in stays in until you lift the mat and tip it out. Look for that construction specifically, and get one larger than you think you need. Cats do not exit a box in a straight line.
One more thing: the mat has to be soft. Cats simply refuse to walk on stiff, spiky mats, and a mat your cat leaps over catches nothing.
2. A higher-sided or top-entry box
A lot of tracking is not tracking at all. It is litter kicked over the side during covering. High sides contain it. A top-entry box contains almost all of it and forces the cat to walk across a lid on the way out, which knocks granules off the paws before they hit the floor.
Not every cat accepts a top-entry box. Older cats and cats with joint trouble often cannot manage the climb. Do not force it.
3. Heavier litter
Lightweight litters are marketed on being easy to carry. They are also easy for a cat to carry, on its paws, into your bedroom. Standard-weight clumping clay tracks noticeably less than the lightweight version of the same product. Larger granules track less than fine ones.
4. Less litter in the box
Most people overfill. Two to three inches is enough for a cat to dig and cover properly. Deeper than that and the surplus mostly ends up outside the box.
5. Trim the fur between the toes
Only relevant for long-haired cats, but for them it is a big one. Litter mats into the tufts between the pads and gets carried a long way. A careful trim with blunt-nosed scissors, or a groomer doing it for you, removes the vehicle.
6. Put the box somewhere with one exit
A box in the middle of a room broadcasts litter in every direction. A box in an alcove, a corner, or against a wall gives it one path out, which is the path your mat is sitting on.
What does not work
Vacuuming more often is not a fix, it is a tax. Litter box liners tear and cats shred them. And moving the box to a room you visit less does not reduce tracking, it just relocates it somewhere you notice later.
The realistic outcome
Do the first two and you will cut visible tracking by most of what you currently deal with. Do all six and you will still find the occasional granule, because you live with a small animal that digs in gravel several times a day. The goal is a floor you are not sweeping daily, not a floor that is never touched.