Passive れる/られる when there's no direct English equivalent — 'meiwaku no ukemi'

I get 'the cake was eaten' = ケーキが食べられた, but then I saw 「雨に降られて、困った」and there's no passive in the English translation at all ('I was troubled because it rained on me'). What's going on grammatically?
Post
沐學 Mizuru