Just wondering

I didn't have to port froward, and allot of people could log into my server with just my ip.

Can any harm be done for me straying from procedure, and skipping 'Port Forwarding'?

Means you're probably not behind a router.