This has been reported by US daily "Wall Street Journal".
The paper however said it is not clear what the two sides discussed.
The Afghan born Khalilzad, who is trying to bring Taliban to negotiating table, is currently on his first trip to the regional countries as special representative for reconciliation in Afghanistan.
It is the second time in four months that American officials have held face-to-face talks with Taliban representatives.
Meanwhile, a State Department spokesman declined to confirm the meeting with Taliban.