GroupLens Research

GroupLens Research

Established	1992
Field of research	recommender systems, social computing
Faculty	5
Staff	2
Students	20 postgraduate students
Location	Minneapolis, MN, US
Operating agency	College of Science and Engineering, University of Minnesota
Website	www.grouplens.org

Coordinates: 44°58′27″N 93°13′57″W / 44.974280°N 93.232502°W

GroupLens Research is a human–computer interaction research lab in the Department of Computer Science and Engineering at the University of Minnesota, Twin Cities specializing in recommender systems and online communities. GroupLens also works with mobile and ubiquitous technologies, digital libraries, and local geographic information systems.

The GroupLens lab was one of the first to study automated recommender systems with the construction of the "GroupLens" recommender, a Usenet article recommendation engine, and MovieLens, a popular movie recommendation site used to study recommendation engines, tagging systems, and user interfaces. The lab has also gained notability for its members' work studying open content communities such as Cyclopath, a computational "geo-wiki" currently being used in the Twin Cities to help plan the regional cycling system.^[1]

History

In 1992, John Riedl and Paul Resnick attended the CSCW conference together. After they heard keynote speaker Shumpei Kumon talk about his vision for an information economy,^[2] they began working on a collaborative filtering system for Usenet news. The system collected ratings from Usenet readers and used those ratings to predict how much other readers would like an article before they read it. This recommendation engine was one of the first automated collaborative filtering systems in which algorithms were used to automatically form predictions based on historical patterns of ratings.^[3] The overall system was called the "GroupLens" recommender, and the servers that collected the ratings and performed the computation were called the "Better Bit Bureau". This name was later dropped after a request from the Better Business Bureau. "GroupLens" is now used as a name both for this recommender system, and for the research lab at the University of Minnesota.

A feasibility test was done between MIT and the University of Minnesota and a research paper was published including the algorithm, the system design, and the results of the feasibility study, in the CSCW conference of 1994.^[4]

In 1993, Riedl and Resnick invited Joseph Konstan to join the team. Together, they decided to create a higher-performance implementation of the algorithms to support larger-scale deployments. In summer 1995 the team gathered Bradley Miller, David Maltz, Jon Herlocker, and Mark Claypool for "Hack Week" to create the new implementation, and to plan the next round of experiments.^[5]

In the Spring of 1996, the first workshop on collaborative filtering was put together by Resnick and Hal Varian at the University of California, Berkeley.^[6] There, researchers from projects around the US that were studying similar systems came together to share ideas and experience.

In the Summer of 1996, David Gardiner, a former Ph.D. student of Riedl's, introduced Riedl to Steven Snyder. Snyder had been one of the early employees at Microsoft, but had left Microsoft to come to Minnesota to do a Ph.D. in Psychology. He realized the commercial potential of collaborative filtering, and encouraged the team to found a company in April 1996. By June, Gardiner, Snyder, Miller, Riedl, and Konstan had incorporated their company, and by July they had their first round of funding, from the Hummer-Winblad venture capital company.^[7] Net Perceptions went on to be one of the leading companies in personalization during the Internet boom of the late 1990s, and stayed in business until 2004.^[8][9] Based on their experience, Riedl and Konstan wrote a book about the lessons learned from deploying recommenders in practice.^[10] Recommender systems have since become ubiquitous in the online world, with leading vendors such as Amazon and Netflix deploying highly sophisticated recommender systems.^[11] Netflix even offered a $1,000,000 prize for improvements in recommender technology.^[12]

Meanwhile, research continued at the University of Minnesota. When the EachMovie^[13] site closed in 1997, the researchers behind it released the anonymous rating data they had collected, for other researchers to use. The GroupLens Research team, led by Brent Dahlen and Jon Herlocker, used this data set to jumpstart a new movie recommendation site called MovieLens which has been a very visible research platform, including a detailed discussion in a New Yorker article by Malcolm Gladwell,^[14] and a report in a full episode of ABC Nightline.^[15]

Between 1997 and 2002 the group continued its research on collaborative filtering, which became known in the community by the more general term of recommender systems. With Joe Konstan's expertise in user interfaces,^[16][17] the team began exploring interface issues in recommenders, such as explanations,^[18] and meta-recommendation systems.^[19]

In 2002, GroupLens expanded into social computing and online communities with the addition of Loren Terveen, who was known for his research of social recommender systems such as PHOAKS.^[20][21]

In order to broaden the set of research ideas and tools they used, Riedl, Konstan, and Terveen invited colleagues in social psychology (Robert Kraut and Sara Kiesler, of the Carnegie Mellon Human Computer Interaction Institute), and economic and social analysis (Paul Resnick and Yan Chen of the University of Michigan School of Information) to collaborate. The new, larger team adopted the name CommunityLab, and looked generally at the effects of technological interventions on the performance of online communities. For instance, some of their research explored technology for enriching conversation systems,^[22] while other research explored the personal, social, and economic motivations for user ratings.^[23][24]

In 2008 GroupLens launched Cyclopath,^[25] a computational geo-wiki for bicyclists within a city.^[26][27]

In 2010, GroupLens won the annual ACM software system award.^[28]

Brent Hecht joined the GroupLens faculty in 2013, focusing on geographic human-computer interaction. Lana Yarosh joined the GroupLens faculty in 2014; she works with social computing and child-computer interaction. A third professor, Haiyi Zhu, joined in 2015. Haiyi has published research on Facebook and other social networks.

Contributions

• The MovieLens recommender system: MovieLens is a non-commercial movie recommender system that has been running for over a decade now, with over 164,000 unique visitors to date, who have provided over 15 million movie ratings.^[29]

• MovieLens ratings datasets: In the early days of recommender systems, research was slowed down by the lack of publicly available datasets. In response to requests from other researchers, GroupLens released three datasets:^[30] the MovieLens 100,000 rating dataset, the MovieLens 1,000,000 rating dataset, and the MovieLens 10,000,000 rating dataset. These datasets became the standard datasets for recommender research, and have been used in over 300 papers by researchers around the world. The dataset is also being used for teaching about recommender technology.^[31]

• MovieLens tagging dataset: GroupLens added tagging to MovieLens in 2006. Since then, users have provided over 85,000 applications of 14,000 unique tags to movies.^[32] The MovieLens 10,000,000 ratings dataset also includes a 100,000 tag applications dataset for researchers to use.

• Information leakage from recommender datasets: a paper in the information retrieval conference analyzed the privacy risks to users of having large recommender datasets released. The basic risk discovered is that an anonymized dataset might be combined with public information to identify a user. For instance, a user who has written about his preference for movies on online forums could be associated with a specific row in the MovieLens datasets. In some cases, these associations might leak information the user would prefer to keep private.^[33][34]

• Wikipedia research: The study of value and vandalism in Wikipedia published in 2007^[35] described the concentration of contribution across Wikipedia editors. This paper was one of the first to focus on the length of time that a contribution survives within Wikipedia as a measure of its value. The paper also investigated the effects of vandalism on Wikipedia readers, by measuring the probability that a view of a page would capture that page in a vandalized state. GroupLens has also explored ways to help editors find pages which they can effectively contribute to with the SuggestBot recommender.^[36] The group has also explored the evolution of the norms in Wikipedia that determine which articles are accepted or rejected, and the effect of changes in those norms on the Long Tail of Wikipedia articles.^[37] GroupLens has also explored the functioning of the informal peer review system within Wikipedia to discover ways the decisions being made appear to be influenced inappropriately by ownership, and that experience does not seem to change editor performance very much.^[38][39] GroupLens researchers have also explored visualizations of the edit history of Wikipedia articles.^[40] In 2011, the GroupLens researchers completed a scientific exploration of gender imbalance in Wikipedia's popular editors, resulting in finding that there was a large gap between male and female editors.^[41]

• Shilling recommender systems: GroupLens has explored ways that users of recommender systems can attempt to inappropriately influence the recommendations given to other users.^[42] They call this behavior shilling, because of its relationship to the practice of hiring associates to pretend to be enthusiastic customers. They showed that some types of shilling are likely to be effective in practice. One concern about shilling is that the false predictions may change the reported opinions of later users, further corrupting the recommendations.^[43][44]

• Cyclopath: Beginning in 2008, GroupLens launched Cyclopath, a computational geo-wiki for local bicyclists. Cyclopath has since been used by hundreds of cyclists within the Twin Cities.^[45] More recently, Cyclopath has been adopted by the Twin Cities Metropolitan Council to help plan the regional cycling system.^[1]

References

1. "Cycloplan". Retrieved 2010-01-04.
2. Kumon, Shumpei (1992). "From wealth to wisdom: a change in the social paradigm". Proceedings of the 1992 ACM conference on Computer-supported cooperative work. Computer Supported Cooperative Work. ACM Press. p. 3. doi:10.1145/143457.371587. ISBN 0-89791-542-9.
3. Goldman, Alvin I (1999). Knowledge in a Social World. Oxford University Press. doi:10.1093/0198238207.001.0001. ISBN 978-0-19-823820-1. Another possibility is "social filtering" systems, such as GroupLens.
4. Resnick, Paul; Iacovou, Neophytos; Suchak, Mitesh; Bergstrom, Peter; Riedl, John (1994). "GroupLens: an open architecture for collaborative filtering of netnews". Proceedings of the 1994 International ACM Conference on Computer Supported Cooperative Work. Computer Supported Cooperative Work. ACM Press. pp. 175–186. doi:10.1145/192844.192905. ISBN 0-89791-689-1.
5. Borchers, Al; Herlocker, Jon; Konstan, Joseph; Riedl, John (April 1998). "Ganging up on Information Overload". Computer. IEEE Computer Society Press. 31 (4): 106–108. doi:10.1109/2.666847. ISSN 0018-9162.
6. "Collaborative Filtering". March 16, 1996. Retrieved 2009-12-30.
7. "Minnesota in the .Com Age" (PDF). Minnesota Public Radio. 1999. Retrieved 2009-12-30.
8. "Firms honored at e-commerce awards". MIT. May 19, 1999.
9. Dragan, Richard (January 2001), "Net Perceptions for E-commerce 6.0", PC Magazine
10. Riedl, John; Konstan, Joseph; Vrooman, Eric (August 2002). Word of Mouse: The Marketing Power of Collaborative Filtering. ISBN 978-0-7595-2727-0.
11. Zeitchik, Steven (July 18, 2008). "Technology Gets Personal". The Wall Street Journal. p. W9. Retrieved 2009-12-23.
12. Hafner, Katie (October 2, 2006). "Netflix offers cash for good suggestions". The New York Times. Retrieved 2009-12-23.
13. Lim, Myungeun; Kim, Juntae (2001). "An Adaptive Recommendation System with a Coordinator Agent". Proceedings of the First Asia-Pacific Conference on Web Intelligence: Research and Development. Asia-Pacific Conference on Web Intelligence. Lecture Notes in Computer Science. 2198/2001. Springer Berlin/Heidelberg. pp. 438–442. doi:10.1007/3-540-45490-X_56. ISBN 978-3-540-42730-8. Retrieved 2009-12-30.
14. Gladwell, Malcolm (October 4, 1999). "Annals of Marketing: The Science of the Sleeper: How the Information Age Could Blow Away the Blockbuster". New Yorker. 75 (29): 48–55. Retrieved 2009-12-29.
15. Krulwich, Robert (December 10, 1999). "ABC Nightline: Soulmate". ABC.
16. "SIGCHI 2003 Election Results". SIGCHI Bulletin. 35 (3). July–August 2003. Retrieved 2010-01-04.
17. Konstan, Joseph (March–April 2004). "President's Report: Advancing the Field". SIGCHI Bulletin. 36 (2). Retrieved 2009-12-30.
18. Herlocker, Jon; Konstan, Joseph; Riedl, John (2000). "Explaining Collaborative Filtering Recommendations". Proceedings of the 2000 ACM conference on Computer supported cooperative work. Computer Supported Cooperative Work. ACM Press. pp. 241–259. doi:10.1145/358916.358995. ISBN 1-58113-222-0.
19. Schafer, J. Ben; Konstan, Joseph; Riedl, John (2002). "Meta-recommendation Systems: User-controlled Integration of Diverse Recommendations". Proceedings of the eleventh international conference on Information and knowledge management. Conference on Information and Knowledge Management. ACM Press. pp. 43–51. doi:10.1145/584792.584803. ISBN 1-58113-492-4. Retrieved 2010-01-06.
20. Lueg, Christopher; Fisher, Danyel, eds. (2003). From Usenet to CoWebs: Interacting with Social Information Spaces. Springer. ISBN 978-1-85233-532-8.
21. Terveen, Loren; Hill, Will; Amento, Brian; McDonald, David; Creter, Josh (March 1997). "PHOAKS: a system for sharing recommendations". Communications of the ACM. ACM Press. 40 (3): 59–62. doi:10.1145/245108.245122. ISSN 0001-0782.
22. Harper, F. Maxwell; Frankowski, Dan; Drenner, Sara; Ren, Yuqing; Kiesler, Sara; Terveen, Loren; Kraut, Robert; Riedl, John (2007). "Talk amongst yourselves: inviting users to participate in online conversations". Proceedings of the 12th international conference on Intelligent user interfaces. International Conference on Intelligent User Interfaces. ACM Press. pp. 62–71. doi:10.1145/1216295.1216313. ISBN 1-59593-481-2. Retrieved 2009-12-29.
23. Harper, F. Maxwell; Li, Xin; Chen, Yan; Konstan, Joseph (2005). "An Economic Model of User Rating in an Online Recommender System". User Modeling 2005 Proceedings. 10th International Conference on User Modeling. Lecture Notes in Computer Science. 3538. Springer. pp. 307–316. doi:10.1007/11527886_40. ISBN 978-3-540-27885-6. Retrieved 2009-12-29.
24. Rashid, Al Mamunur; Ling, Kimberly; Tassone, Regina D.; Resnick, Paul; Kraut, Robert; Riedl, John (2006). "Motivating Participation by Displaying the Value of Contribution". Proceedings of the 2006 CHI Conference. ACM SIGCHI Conference on Human Factors in Computing Systems. Lecture Notes in Computer Science. 3538. Springer. pp. 955–958. doi:10.1145/1124772.1124915. ISBN 1-59593-372-7. Retrieved 2009-12-30.
25. "cyclopath.org". cyclopath.org. Retrieved 2012-01-06.
26. Gonzalez, Tony (July 18, 2008). "Biking website pools cyclists' expertise". Star Tribune. Minneapolis. Retrieved 2010-01-04.
27. Chin, Richard (July 19, 2008). "Mapquest for the cycling set". St. Paul Pioneer Press. p. A1. Archived February 18, 2015, at the Wayback Machine..
28. "Software System Award - Award Winners: List By Year". acm.org.
29. Vig, Jesse; Sen, Shilad; Riedl, John (2009). "Tagsplanations: Explaining Recommendations using Tags". Proceedings of the 13th international conference on Intelligent user interfaces. International Conference on Intelligent User Interfaces. ACM Press. pp. 47–56. doi:10.1145/1502650.1502661. ISBN 978-1-60558-168-2. Retrieved 2009-12-30.
30. http://www.grouplens.org/node/73
31. Segaran, Toby (August 2007). Programming Collective Intelligence: Building Smart Web 2.0 Applications. O'Reilly Media. ISBN 978-0-596-52932-1.
32. Sen, Shilad; Vig, Jesse; Riedl, John (2009). "Tagommenders: Connecting Users to Items through Tags". Proceedings of the 18th international conference on World wide web. International World Wide Web Conference. ACM Press. pp. 671–680. doi:10.1145/1526709.1526800. ISBN 978-1-60558-487-4. Retrieved 2009-12-29.
33. Frankowski, Dan; Cosley, Dan; Sen, Shilad; Terveen, Loren; Riedl, John (2006). "You are what you say: privacy risks of public mentions". Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval. Annual ACM Conference on Research and Development in Information Retrieval. ACM Press. pp. 565–572. doi:10.1145/1148170.1148267. ISBN 1-59593-369-7. Retrieved 2009-12-29.
34. Schneier, Bruce (August 2006). "Schneier on Security: A blog covering security and security technology". Retrieved 2009-12-29.
35. Priedhorsky, Reid; Chen, Jilin; Lam, Shyong (Tony); Panciera, Katherine; Terveen, Loren; Riedl, John (2007). "Creating, Destroying, and Restoring Value in Wikipedia". Proceedings of the 2007 international ACM conference on Supporting group work. Conference on Supporting Group Work. ACM Press. pp. 259–268. doi:10.1145/1316624.1316663. ISBN 978-1-59593-845-9. Retrieved 2009-12-29.
36. Cosley, Dan; Frankowski, Dan; Terveen, Loren; Riedl, John (2008). "SuggestBot: Using Intelligent Task Routing to Help People Find Work in Wikipedia". Proceedings of the 12th international conference on Intelligent user interfaces. Conference on Intelligent User Interfaces. ACM Press. pp. 32–41. doi:10.1145/1216295.1216309. ISBN 1-59593-481-2. Retrieved 2010-01-04.
37. Lam, Shyong (Tony) K.; Riedl, John (2009). "Is Wikipedia Growing a Longer Tail?". Proceedings of the 2009 international ACM conference on Supporting Group Work. International Conference on Supporting Group Work. ACM Press. pp. 105–114. doi:10.1145/1531674.1531690. ISBN 978-1-60558-500-0. Retrieved 2010-01-04.
38. Halfaker, Aaron; Kittur, Aniket; Kraut, Robert; Riedl, John (2009). "A Jury of Your Peers: Quality, Experience and Ownership in Wikipedia". Proceedings of the 2009 International Symposium on Wikis and Open Collaboration. International Symposium on Wikis and Open Collaboration. ACM Press. doi:10.1145/1641309.1641332. ISBN 978-1-60558-730-1. Retrieved 2010-01-04.
39. Panciera, Katherine; Halfaker, Aaron; Terveen, Loren (2009). "Wikipedians are born, not made: a study of power editors on Wikipedia". Proceedings of the 2009 international ACM conference on Supporting Group Work. International Conference on Supporting Group Work. ACM Press. doi:10.1145/1531674.1531682. ISBN 978-1-60558-500-0. Retrieved 2010-01-04.
40. Ekstrand, Michael; Riedl, John (2009). "rv you're dumb: Identifying Discarded Work in Wiki Article History". Proceedings of the 2009 International Symposium on Wikis and Open Collaboration. International Symposium on Wikis and Open Collaboration. ACM Press. doi:10.1145/1641309.1641317. ISBN 978-1-60558-730-1. Retrieved 2010-01-04.
41. Lam, Shyong K.; Anuradha, Uduwage; Zhenhua, Dong; Sen, Shilad; Riedl, John (2011). "WP: Clubhouse? An Exploration of Wikipedia's Gender Imbalance". Proceedings of the 7th international symposium on wikis and open collaboration. The International Symposium on Wikis and Open Collaboration. ACM Press. pp. 1–10. doi:10.1145/2038558.2038560. Retrieved 2011-10-25.
42. Lam, Shyong K.; Riedl, John (2004). "Shilling recommender systems for fun and profit". Proceedings of the 13th international conference on World Wide Web. International World Wide Web Conference. ACM Press. pp. 393–402. doi:10.1145/988672.988726. ISBN 1-58113-844-X. Retrieved 2010-01-04.
43. Charles, Julie (May 22, 2003). "False Web Ratings Swing Opinion, Study Says". The New York Times. p. G4. Retrieved 2009-12-23.
44. Cosley, Dan; Lam, Shyong K.; Albert, Istvan; Konstan, Joseph A.; Riedl, John (2003). "Is Seeing Believing? How Recommender Systems Influence Users' Opinions". ACM SIGCHI Conference on Human Factors in Computing Systems. Conference on Human Factors in Computing Systems. ACM Press. doi:10.1145/642611.642713. ISBN 1-58113-630-7. Retrieved 2010-01-04.
45. Priedhorsky, Reid; Masli, Mikhil; Terveen, Loren (2010). "Eliciting and Focusing Geographic Volunteer Work". Proceedings of the 2010 ACM conference on Computer supported cooperative work. Conference on Computer Supported Cooperative Work. ACM Press. doi:10.1145/1718918.1718931. ISBN 978-1-60558-795-0. Retrieved 2010-03-02.

External links

• GroupLens Research Homepage
• The MovieLens Recommender System
• John Riedl's invited talk at RecSys'06 in Bilbao
• Recommendations 2.0 by John Riedl, Ph.D.
• Is technology narrowing our experiences?
• GroupLens Research (Recommender Systems)
• If TiVo Thinks You Are Gay, Here's How to Set It Straight
• Stefik, Mark; Stefik, Barbara (October 2004). Breakthrough: Stories and Strategies of Radical Innovation. MIT Press. ISBN 978-0-262-19514-0. Mentions John Riedl and his research