The Tyranny of Possibilities in the Design of Task-Oriented LLM Systems: A Scoping Survey