Services are expected to achieve a good balance between superior cost performance and a high degree of satisfaction. Network operators should estimate service and system performance not only from the perspective of engineering but also from the user's point of view. The aim of our evaluation is to find a method for quantitative analysis of factors affecting subjective quality assessments. Many factors are assumed to affect mobile service quality. We chose three factors-application classification, place of use, and degree of relaxation-from a network design perspective. However, it was difficult to consider such factors in a traditional laboratory experiment. We developed an evaluation system for a field experiment with a large number of participants under controlled waiting time conditions. The system allowed the consideration of new factors and the quantitative estimation of their effects using a statistical evaluation.