If I were you, I wouldn't do anything. But keep an eye on your porn from awhile. If you see your brother has been looking at it some more, it's probably a good idea to talk to him about it.
Awhile back my step-brother did the same thing(although he browsed the files on my computer using Firefox, for some baffling reason). Just be thankful that all you have to hide is gay porn.
