Evaluating online services based on a ranked pairs social choice function

FU Xiaodong; LI Jun; LIU Li; YUE Kun; FENG Yong; LIU Lijun

doi:10.16511/j.cnki.qhdxxb.2018.21.018

PDF(1312 KB)

Journal of Tsinghua University(Science and Technology) ›› 2018, Vol. 58 ›› Issue (8) : 715-724. DOI: 10.16511/j.cnki.qhdxxb.2018.21.018

COMPUTER SCIENCE AND TECHNOLOGY

Evaluating online services based on a ranked pairs social choice function

{{article.zuoZhe_EN}}

Author information +

History +

Abstract

Different customers may have different evaluation criteria which leads to different ratings of online services. Thus, aggregation of the ratings cannot objectively evaluate the services. This paper presents an online services evaluation method based on a ranked pairs social choice function. The method uses preference relations rather than ratings to evaluate the online services. First, the preference relations of the customer are calculated based on a ratings matrix. Then, a list of online service pairs is established according to the service priority relationship determined from the majority rule. Finally, a directed acyclic graph is constructed and a path is found in the graph that contains all the online services. The service order in the path is then used to evaluate the services. A theoretical analysis and tests verify the reasonability and effectiveness of this method.

Key words

online services evaluation / incomparable ratings / ranked pairs / service ranking

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

FU Xiaodong, LI Jun, LIU Li, YUE Kun, FENG Yong, LIU Lijun. Evaluating online services based on a ranked pairs social choice function[J]. Journal of Tsinghua University(Science and Technology). 2018, 58(8): 715-724 https://doi.org/10.16511/j.cnki.qhdxxb.2018.21.018

References

[1] KRAUSE A, HORVITZ E. A utility-theoretic approach to privacy in online services[J]. Journal of Artificial Intelligence Research, 2014, 39(1):633-662.
[2] 王尚广, 孙其博, 杨放春. Web服务选择中信誉度评估方法[J]. 软件学报, 2012, 23(6):1350-1367.WANG S G, SUN Q B, YANG F C. Reputation evaluation approach in Web service selection[J]. Journal of Software, 2012, 23(6):1350-1367.(in Chinese)
[3] 蒋哲远, 韩江洪, 王钊. 动态的QoS感知Web服务选择和组合优化模型[J]. 计算机学报, 2009, 32(5):1014-1025.JIANG Z Y, HAN J H, WANG Z. An optimization model for dynamic QoS-aware Web services selection and composition[J]. Chinese Journal of Computers, 2009, 32(5):1014-1025. (in Chinese)
[4] BHARGAVA K, GUJRAL T, CHAWLA M, et al. Comment based seller trust model for E-commerce[C]//Proceedings of 2016 International Conference on Computational Techniques in Information and Communication Technologies. New Delhi, India:IEEE, 2016:387-391.
[5] ZHANG X Z, CUI L S, WANG Y. Computing multi-dimensional trust by mining E-commerce feedback comments[J]. IEEE Transactions on Knowledge & Data Engineering, 2014, 26(7):1631-1643.
[6] YAO Y, RUOHOMAA S, XU F. Addressing common vulnerabilities of reputation systems for electronic commerce[J]. Journal of Theoretical & Applied Electronic Commerce Research, 2012, 7(1):1-20.
[7] FU X D, YUE K, LIU L, et al. Aggregating ordinal user preferences for effective reputation computation of online services[C]//Proceedings of 2016 IEEE International Conference on Web Services. San Francisco, USA:IEEE, 2016:554-561.
[8] 付晓东, 邹平, 姜瑛. 基于质量相似度的Web服务信誉度量[J]. 计算机集成制造系统, 2008, 14(3):619-624.FU X D, ZOU P, JIANG Y. Web service reputation measurement based on quality of service similarity[J]. Computer Integrated Manufacturing Systems, 2008, 14(3):619-624. (in Chinese)
[9] DEY P, MISRA N, NARAHARI Y. Kernelization complexity of possible winner and coalitional manipulation problems in voting[J]. Theoretical Computer Science,2016, 616(1):111-125.
[10] MCAULEY J, LESKOVEC J, JURAFSKY D. Learning attitudes and attributes from multi-aspect reviews[Z/OL]. (2012-11-31). https://arxiv.org/abs/1210.3926.
[11] HSIEH H Y, WU S H. Ranking online customer reviews with the SVR model[C]//Proceedings of 2015 IEEE International Conference on Information Reuse and Integration. San Francisco, USA:IEEE, 2015:550-555.
[12] SCAFFIDI C, BIERHOFF K, CHANG E, et al. Red Opal:Product-feature scoring from reviews[C]//Proceedings of the 8th ACM Conference on Electronic Commerce. San Diego, USA:ACM, 2007:182-191.
[13] 吕品, 钟珞, 唐琨皓. 在线产品评论用户满意度综合评价研究[J]. 电子学报, 2014, 42(4):740-746.LÜ P, ZHONG L, TANG K H. Customer satisfaction degree evaluation of online product review[J]. Acta Electronica Sinica, 2014, 42(4):740-746. (in Chinese)
[14] 王玉祥, 乔秀全, 李晓峰,等. 上下文感知的移动社交网络服务选择机制研究[J].计算机学报, 2010, 33(11):2126-2135.WANG Y X, QIAO X Q, LI X F, et al. Research on context-awareness mobile SNS service selection mechanism[J]. Chinese Journal of Computers, 2010, 33(11):2126-2135. (in Chinese)
[15] JOSANG A, ISMAIL R. The beta reputation system[C/OL].[2017-06-01]. http://aisel.aisnet.org/bled2002/41/.
[16] ARROW K J. Social choice and individual values[M]. New Haven, USA:Yale university press, 2012.
[17] DAVID H A. The method of paired comparisons[M]. 2nd ed. London, UK:Hodder Arnold, 1988.
[18] OKASHA S. Theory choice and social choice:Kuhn versus Arrow[J]. Mind, 2011, 120(477):83-115.
[19] TIDEMAN T N. Independence of clones as a criterion for voting rules[J]. Social Choice and Welfare, 1987, 4(3):185-206.
[20] VIGLAS S D. Rate-based query optimization for streaming information sources[C]//Proceedings of 2002 ACM SIGMOD International Conference on Management of Data. Madison, USA:ACM, 2002:37-48.
[21] 张莉, 张斌, 黄利萍,等. 基于服务调用特征模式的个性化Web服务QoS预测方法[J]. 计算机研究与发展, 2013, 50(5):1066-1075.ZHANG L, ZHANG B, HUANG L P, et al. A personalized Web service quality prediction approach based on invoked feature model[J]. Journal of Computer Research & Development, 2013, 50(5):1066-1075. (in Chinese)
[22] ZHAO T, MCAULEY J, KING I. Leveraging social connections to improve personalized ranking for collaborative filtering[C]//Proceedings of the 23rd ACM International Conference on Conference on Information & Knowledge Management. Shanghai, China:ACM, 2014:261-270.
[23] HARPER F M, KONSTAN J A. The MovieLens datasets:History and context[J]. ACM Transactions on Interactive Intelligent Systems, 2015, 5(4):19.
[24] FANG W D, ZHANG C L, SHI Z D, et al. BTRES:Beta-based trust and reputation evaluation system for wireless sensor networks[J]. Journal of Network & Computer Applications, 2016, 59:88-94.
[25] HERINGS P J J, HOUBA H. The Condorcet paradox revisited[J]. Social Choice and Welfare, 2016, 47(1):141-186.