Rate control of a queue with quality-of-service constraint under bounded and unbounded action spaces