When should empty plates be cleared by your server?

I had just given up trying to best my falafel sandwich at Zaina earlier this week when a server approached the table and asked if my wife and I were done.
“Yes,” I replied.
“Great. We’re running out of plates,” he said, glancing around the full dining room before clearing the table.