I actually found the solution !
My laptop was getting too hot, so it engaged thermal throtling.
So to prevent that what I did was I undervolted the laptop and I used throttle stop to turn off the turbo boost of the laptop.
My temperature went from 90 degrees celcius+ to 60-75 degrees celcius maximum during gameplay.
Big improvement....and also removed all the frame drops !
Thanks for the suggestion though