Nunez: It's tough to leave Twins