Sarri ‘getting used to’ fans frustration but refuses to quit