The bending of space-time causes objects to move on a curved path and that curvature of space is what we know as gravity. Mathematically one can go backwards or forwards in the three spatial dimensions. But time doesn't share this multi-directional freedom.
