More of the moment arm from the center of mass is cancelled out by the farther finger and it feels less friction. The closer finger will experience a greater moment/more friction and move with less ease. Assuming you apply the same amount of force to both fingers they inevitably end up at the center of mass, cancelling the moment.