Dear Mr The Fear,
I was looking early at the trainingpeaks.com Annual Training Plan wizard. It suggests that the lower limit for a HIM is 500 hours per year. If you allow a bit of time off for a holiday, that is probably 12 hours per week.
I am budgeting between six and ten per week, max.
Should I be concerned?