They've gone back and forth depending on their perception of how well the ICRC is doing its job:
* Withdrawal: https://www.rferl.org/a/afghanistan-taliban-withdraws-icrc-s...
* Restoration: http://cms.trust.org/item/20181012103241-lymfx
* https://www.npr.org/2019/09/16/761152686/taliban-lifts-ban-o...