Conte was ‘worried’ about Spurs’ first three games