Not necessarily. This is Just to Say is a very famous poem that doesn’t rhyme at all.

I have eaten

the plums

that were in

the icebox

.

and which

you were probably

saving

for breakfast

.

Forgive me

they were delicious

so sweet

and so cold