I didn't get that vibe. To me it seemed they were just worried that their coworkers would be upset that they were leaving the department, especially without telling them, and that because there had been some stuff said that was unflattering about HR, maybe the TMs would be petty about it and possibly badmouth the OP.