Can lithium battery be overloaded?

Yes but this will reduce capacity / consumption accordingly.