There might be something wrong on your system. I switched a long time ago but sometimes run chrome to compare performance, and it's on a par.
If you come across a site where the performance is noticeably worse than in Chrome, it may be worth notifying the owner. The alternative is to live in a Google-controlled dystopia.