While they might not look like the traditional "berry" you might picture, botanically speaking, a berry is a fruit that develops from a single ovary and contains multiple seeds.

Bananas fit this definition, as they develop from a single ovary and have many tiny seeds (which are often not noticeable in commercially grown bananas).