James Caan Didn’t Find Will Ferrell Funny on Elf Set and Was ‘Truly Annoyed’ With Him