he invites me yesterday diubah ke kalimat pasif

I was invited (by him) yesterday.
The reason is that the statement should've been "He invited me yesterday" as it happened in the past {yesterday}.
Therefore, the passive voice for this statement should be "I was invited yesterday" as the rule for Simple Past passive voice is "Subject (formerly object) + finite to be (in this case past tense was/were) + Past Participle).