No – allowances are made for beginners, and with regular training you will become fitter, even if you have physical restrictions.
As a beginner, you will be training with all grades right up to 4th and 5th Dan black belts. Obviously you wouldn’t be expected to be able to keep up with a 5th Dan, however, you will be expected to try your best at all times.