This figure of speech comes from a time when there would be performances (or, ‘acts’) done by different performers. If one performance was excellent, the next performer might say ‘that is a tough (difficult) act to follow’ (difficult to improve upon). The phrase can be used to talk about one’s own performance doing a task.