Action time also affects skill gain. The longer the action, the more skill you gain for that action.
Nutrition also affects skill gain. Starting at 6050% nutrition you receive a 1% bonus, continuing at 1% every 10% nutrition up to a 5% bonus at 99%.