Can any builder give me some advice?

l have laid a garden path with slabs that have a tapered edge so there is quite a gap on the face side, l have tried to point the gaps with coarse sand, and cement, when its wet it looks ok but when the joints dry out they just crack and wash out , can you help...j