Indeed, first install those updates.
libegl1-mesa should be available on 20.04 in the universe repo. It's actually a transitional dummy package, so there's nothing in it and it only serves to match dependencies.
Your problem with vim over ssh isn't likely to be caused by vim (as then it would happen without ssh too). I expect it to be problem with ssh or with the terminal you use on the computer you connect from.
Bookmarks