The correct sentence would be:
"I have talked to him several times."
Explanation:
"Several" is used to indicate an unspecified but relatively small number of times.
It fits here because you're indicating that you've talked to him more than once, but not necessarily a specific number of times.
