![The real story
3. Settled for classification of binary outcomes (e.g.
adult/non-adult)
y (xi ) = w · xi + b
ˆ
Support Vector Machine : L(y , y ) = C
ˆ i [1 − yi y (xi )]+ + ||w ||2
ˆ
Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 37 / 42](https://image.slidesharecdn.com/jsm20110801-110817162459-phpapp02/85/Learning-from-Web-Activity-45-320.jpg)
More Related Content
Similar to Learning from Web Activity
Learning from Web Activity
- 1. Learning from WebActivity Jake Hofman Joint work with Irmak Sirer & Sharad Goel Yahoo! Research August 1, 2011 Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 1 / 42
- 2. Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 2 / 42
- 3. “... applies socialsciences techniques, including algorithmic game theory, economics, network analysis, psychology, ethnography, and mechanism design, to online situations.” http://research.yahoo.com Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 3 / 42
- 4. possible to estimateaccurately the age of ori- biodiversification event in the Paleogene (65 to 8. M. Foote, in Evolutionary Patterns, J. B. C. Jackson et al., Eds. (Univ. of Chicago Press, Chicago, IL, 2001), vol. 245, gin of almost all extant genera. It is then possi- 23 million years ago) that is perhaps not yet pp. 245–295. ble to plot a backward survivorship curve (8) captured in Alroy et al.’s database (5, 7). The 9. M. D. Spalding et al., Bioscience 57, 573 (2007). for each of the 27 global bivalve provinces (9). jury is still out on what may have caused this 10. S. M. Stanley, Paleobiology 33, 1 (2007). 11. M. J. Benton, B. C. Emerson, Palaeontology 50, 23 (2007). On the basis of these curves, Krug et al. find event. But we should not lose sight of the fact that origination rates of marine bivalves in- that the steep rise to prominence of many mod- 10.1126/science.1169410 SOCIAL SCIENCE A field is emerging that leverages the capacity to collect and analyze data at a Computational Social Science scale that may reveal patterns of individual and group behaviors. David Lazer,1 Alex Pentland,2 Lada Adamic,3 Sinan Aral,2,4 Albert-László Barabási,5 Devon Brewer,6 Nicholas Christakis,1 Noshir Contractor,7 James Fowler,8 Myron Gutmann,3 Tony Jebara,9 Gary King,1 Michael Macy,10 Deb Roy,2 Marshall Van Alstyne2,11 W“... a computational social science is emerging that e live life in the network. We check ment agencies such as the U.S. National Secur- critiqued or replicated. Neither scenario will our e-mails regularly, make mobile ity Agency. Computational social science could serve the long-term public interest of accumu- phone calls from almost any loca- become the exclusive domain of private com- lating, verifying, and disseminating knowledge. tion, swipe transit cards to use public trans- panies and government agencies. Alternatively, What value might a computational social leverages the capacity to collect and analyze data with an portation, and make purchases with credit cards. Our movements in public places may be there might emerge a privileged set of aca- demic researchers presiding over private data science—based in an open academic environ- ment—offer society, by enhancing understand- unprecedented breadth and depth and scale ...” captured by video cameras, and our medical records stored as digital files. We may post blog from which they produce papers that cannot be ing of individuals and collectives? What are the entries accessible to anyone, or maintain friend- ships through online social networks. Each of these transactions leaves digital traces that can http://sciencemag.org/content/323/5915/721 be compiled into comprehensive pictures of both individual and group behavior, with the potential to transform our understanding of our lives, organizations, and societies. The capacity to collect and analyze massive amounts of data has transformed such fields as biology and physics. But the emergence of a data-driven “computational social science” has been much slower. Leading journals in eco- nomics, sociology, and political science show little evidence of this field. But computational social science is occurring—in Internet compa- nies such as Google and Yahoo, and in govern- Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 4 / 42
- 5. possible to estimateaccurately the age of ori- biodiversification event in the Paleogene (65 to 8. M. Foote, in Evolutionary Patterns, J. B. C. Jackson et al., Eds. (Univ. of Chicago Press, Chicago, IL, 2001), vol. 245, gin of almost all extant genera. It is then possi- 23 million years ago) that is perhaps not yet pp. 245–295. ble to plot a backward survivorship curve (8) captured in Alroy et al.’s database (5, 7). The 9. M. D. Spalding et al., Bioscience 57, 573 (2007). for each of the 27 global bivalve provinces (9). jury is still out on what may have caused this 10. S. M. Stanley, Paleobiology 33, 1 (2007). 11. M. J. Benton, B. C. Emerson, Palaeontology 50, 23 (2007). On the basis of these curves, Krug et al. find event. But we should not lose sight of the fact that origination rates of marine bivalves in- that the steep rise to prominence of many mod- 10.1126/science.1169410 SOCIAL SCIENCE A field is emerging that leverages the capacity to collect and analyze data at a Computational Social Science scale that may reveal patterns of individual and group behaviors. David Lazer,1 Alex Pentland,2 Lada Adamic,3 Sinan Aral,2,4 Albert-László Barabási,5 Devon Brewer,6 Nicholas Christakis,1 Noshir Contractor,7 James Fowler,8 Myron Gutmann,3 Tony Jebara,9 Gary King,1 Michael Macy,10 Deb Roy,2 Marshall Van Alstyne2,11 W“... shares with other nascent interdisciplinary fields e live life in the network. We check ment agencies such as the U.S. National Secur- critiqued or replicated. Neither scenario will our e-mails regularly, make mobile ity Agency. Computational social science could serve the long-term public interest of accumu- phone calls from almost any loca- become the exclusive domain of private com- lating, verifying, and disseminating knowledge. tion, swipe transit cards to use public trans- panies and government agencies. Alternatively, What value might a computational social (e.g., sustainability science) the need to develop a portation, and make purchases with credit cards. Our movements in public places may be there might emerge a privileged set of aca- demic researchers presiding over private data science—based in an open academic environ- ment—offer society, by enhancing understand- paradigm for training new scholars ...” captured by video cameras, and our medical records stored as digital files. We may post blog from which they produce papers that cannot be ing of individuals and collectives? What are the entries accessible to anyone, or maintain friend- ships through online social networks. Each of these transactions leaves digital traces that can http://sciencemag.org/content/323/5915/721 be compiled into comprehensive pictures of both individual and group behavior, with the potential to transform our understanding of our lives, organizations, and societies. The capacity to collect and analyze massive amounts of data has transformed such fields as biology and physics. But the emergence of a data-driven “computational social science” has been much slower. Leading journals in eco- nomics, sociology, and political science show little evidence of this field. But computational social science is occurring—in Internet compa- nies such as Google and Yahoo, and in govern- Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 4 / 42
- 6. The clean realstory “ We have a habit in writing articles published in scientific journals to make the work as finished as possible, to cover all the tracks, to not worry about the blind alleys or to describe how you had the wrong idea first, and so on. So there isn’t any place to publish, in a dignified manner, what you actually did in order to get to do the work ...” -Richard Feynman Nobel Lecture 1 , 1965 1 http://bit.ly/feynmannobel Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 5 / 42
- 7. Outline • The clean story • The real story • Lessons learned Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 6 / 42
- 8. Demographic diversity onthe Web with Irmak Sirer and Sharad Goel The clean story (covering our tracks) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 7 / 42
- 9. Motivation Previous work is largely survey-based and focuses and group-level differences in online access Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 8 / 42
- 10. Motivation “As of January 1997, we estimate that 5.2 million African Americans and 40.8 million whites have ever used the Web, and that 1.4 million African Americans and 20.3 million whites used the Web in the past week.” -Hoffman & Novak (1998) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 8 / 42
- 11. Motivation Chang, et. al., ICWSM (2010) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 9 / 42
- 12. Motivation Focus on activity instead of access How diverse is the Web? To what extent do online experiences vary across demographic groups? Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 10 / 42
- 13. Data • Representative sample of 265,000 individuals in the US, paid via the Nielsen MegaPanel2 • Log of anonymized, complete browsing activity from June 2009 through May 2010 (URLs viewed, timestamps, etc.) • Detailed individual and household demographic information (age, education, income, race, sex, etc.) 2 Special thanks to Mainak Mazumdar Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 11 / 42
- 14. Data • Transform all demographic attributes to binary variables e.g., Age → Over/Under 25, Race → White/Non-White, Sex → Female/Male Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 12 / 42
- 15. Data • Transform all demographic attributes to binary variables e.g., Age → Over/Under 25, Race → White/Non-White, Sex → Female/Male • Normalize pageviews to at most three domain levels, sans www e.g. www.yahoo.com → yahoo.com, us.mg2.mail.yahoo.com/neo/launch → mail.yahoo.com Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 12 / 42
- 16. Data • Transform all demographic attributes to binary variables e.g., Age → Over/Under 25, Race → White/Non-White, Sex → Female/Male • Normalize pageviews to at most three domain levels, sans www e.g. www.yahoo.com → yahoo.com, us.mg2.mail.yahoo.com/neo/launch → mail.yahoo.com • Restrict to top 100k (out of 9M+ total) most popular sites (by unique visitors) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 12 / 42
- 17. Data • Transform all demographic attributes to binary variables e.g., Age → Over/Under 25, Race → White/Non-White, Sex → Female/Male • Normalize pageviews to at most three domain levels, sans www e.g. www.yahoo.com → yahoo.com, us.mg2.mail.yahoo.com/neo/launch → mail.yahoo.com • Restrict to top 100k (out of 9M+ total) most popular sites (by unique visitors) • Aggregate activity at the site, group, and user levels Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 12 / 42
- 18. Site-level skew How diverse are site audiences? • For each site and attribute, calculate the skew in visitors (e.g., 93% of pageviews on Density foxnews.com are by White users) • For each attribute, plot the distribution of visitor skew across all sites 0.0 0.2 0.4 0.6 0.8 1.0 Proportion White Visitors Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 13 / 42
- 19. Site-level skew Density Density Density 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 Proportion Female Visitors Proportion White Visitors Proportion College Educated Visitors Density Density 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 Proportion of Visitors With Proportion Adult Visitors Household Incomes Under $50,000 Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 14 / 42
- 20. Site-level skew Many sites have skew close the overall mean, but there also popular, highly-skewed sites Greater Than 90% Less Than 10% youravon.com coveritlive.com Female collectionsetc.com needlive.com foxnews.com blackplanet.com White wunderground.com mediatakeout.com news.google.com slumz.boxden.com College Educated nytimes.com sythe.com mail.yahoo.com nanowrimo.org Over 25 Years Old apps.facebook.com cbox.ws Household Income scarleteen.com opentable.com Under $50,000 boards.adultswim.com marketwatch.com Table 1: A selection of popular sites that are homogeneous along various demographic dimensions. visually apparent from Figure 5, there are significant differ- College Female 70 Non−White ! Over 25 ences in how groups distribute their time on the web. These ! ! 60 differences—which, as mentioned above, hold for highly fre- r−Capita Pageviews ! quented sites such as Facebook and YouTube—are in some White No College 50 cases even more pronounced for lower traffic sites. For in- 40 Male stance, the gaming site pogo.com accounts for less than 1% 30 of pageviews among both low and high income users, but Jake Hofman (hofman@yahoo-inc.com) Under 25 Learning from Web Activityusers spend almost twice as much of their time 15 / 42 low income JSM, 2011.08.01
- 21. Site-level skew This skew persists even when we restrict attention to the top 10k or 1k sites 1.0 1.0 1.0 Proportion College Educated Visitors Proportion Female Site Visitors Proportion White Site Visitors 0.8 0.8 0.8 0.6 0.6 0.6 0.4 0.4 0.4 0.2 0.2 0.2 0.0 0.0 0.0 101 102 103 104 105 101 102 103 104 105 101 102 103 104 105 Site Rank Site Rank Site Rank 1.0 1.0 Household Incomes Under $50,000 Proportion of Adult Site Visitors 0.8 0.8 Proportion of Visitors With 0.6 0.6 0.4 0.4 0.2 0.2 0.0 0.0 101 102 103 104 105 101 102 103 104 105 Site Rank Site Rank Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 16 / 42
- 22. Sites vs. ZIPs How do diversity of the online and offline worlds compare? Sites Sites ZIPs ZIPs Density Density 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 Proportion Female Proportion White Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 17 / 42
- 23. Sites vs. ZIPs How do diversity of the online and offline worlds compare? Sites Sites ZIPs ZIPs Density Density 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 Proportion Female Proportion White As expected, neighborhoods are more gender-balanced than sites Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 17 / 42
- 24. Sites vs. ZIPs How do diversity of the online and offline worlds compare? Sites Sites ZIPs ZIPs Density Density 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 Proportion Female Proportion White But sites typically have more racially diverse audiences than neighborhoods have residents Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 17 / 42
- 25. Site-level skew p.adult p.female p.white q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q qq q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q qq q q q q q q q q qq q q q q q q q qq qq q q q q q q qq qq q q q q q q qq qq q q q q q q q qq q q q q q qq q q q q q qq q q q q q qq q q qq qq q q qq qq q q q q q qq qqq q qq q q q qq q q q q q q q qq qqq q qq q q q qq q q q q q q q qq qqq q qq q q q qq q q q qq q q q qq q q qq q q q qq q q qq q q q qq q q q q q q q q qq q q q q q q q q q q q qq q q q q q q q q q q q qq q q q q q q qq q qq q q q q q q q q q q qq q qq q q q q q q q q q q qq q qq q q q q q q q q q q q qq q q q q q q q q qq q q q q q q q q qq q q q q q qq qq q q q q qq qq q q q q qq qq q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q qq q q q q q q q q qq q q q q q q q q q qq q q q q q q q q qq q q q q q q q q q qq q q q q q q q q qq q q q q q qqq qq q q qq q q q q q q qqq qq q q qq q q q q q q qqq qq q q qq q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q qq q q q qq q q q q q q q q q q q q q qq q q q q qq q q q q qq q q q qq q q q q q q q q q q q q q qq q q q q qq q q q q qq q q q qq q q q q q q q q q q q q q qq q q q q q q q qq q q q q q qq q q q q q qq q q q q q q q qq q q q qq q q q q q q q q q q q qq q q q qq q q q q q q q q q q q qq q q q q q qq q q q q q q q q q q q q q q q qq q q q q q q q qq q q q qq qq qq q q q q q q q q q q q q q q q q qq q q q q q q q qq q q q qq qq qq q q q q q q q q q q q q q q qq q q q q q q qq q q qq q qq q q q q q q q q q q q q q qqq qq qq q qq q q q q q q qqq qq qq q qq q q q q q q qqq qq qq q qq q q q q q qqq q q q q q q q q qq qq q q q q q q q q q q q q q q qqq q q q q q q q q qq qq q q q q q q q q q q q q q qqq q q q q q q q q qq qq q q q q q q q q q q q qq q q q q q q q q q qq q qqq qqq q qq q q qqq q q q q qq q q qq q q q q qq q q q q q q q qq q q q q q q q q q qq q qqq qqq q qq q q q q q q qq q q qq q q q q q q q q q q q qq q q q q q q q q q qq q qqq qqq q qq q q q q q q qq q q q q q q q qq q q q q q q qq q q q q q q q qq q q q q q qq q q qq q q qq q q q q q qq q q q q q q q q q q q q qq q qq q q q q qq q q q q q q q q q q q q q q q q qq q q q q q q qq q q q q q q q q q q q q q q q q qq q q q q q q qq q q q q q q q q q q q q q q q q q q q q qqq q q q qqq q q q q q q qq q q q q qqq q q q q qq qq q q q q q q q q q q q q q qq q q q q qqq q q q qqq q q q q q q qq q q q q qqq q q q q qq qq q q q q q q q q q q q q q qq q q q q qqq q q q qqq q q q q q q qq q q q q qqq q q q q qq qq q q q q q q qq qqq q qq q q qq q q q q q qq q qq q q q q qq q q qq q q q q q q q q q qq q q qq qq qq q qq qqq q qq q q qq q q q q q qq q qq q q q q qq q q qq q q q q q q q q q qq q q qq qq qq q qq qqq q qq q q qq q q q q q qq q qq q q q q qq q q qq q q q q q q q q q qq q q qq qq qq q q q q q q q q q qq q q q q qq qq q q q q qq qq q qq qq qq q q q q q q q q q q q q q q q q q q q q qq q q q q qq qq q q q q qq qq q qq qq qq q q q q q q q q q q q q q q q q q q q q qq q q q q qq qq q q q q qq qq q qq qq qq q q q q q q q q q q q q q qq q q q q q q qq q q q q qq q q qqq q q qqq q q qq q qq q q qq q q qq qq qq q q q q qq q q q q q qq q q q q qq q q qqq q q qqq q q qq q qq qq q q qq qq qq q q q q qq q q q q q qq q q q q qq q q qqq q q qqq q q qq q qq qq q q qq qq qq q q q q q q qq q q q qq q q q q q q qq q qq q qq q q qq qq q q qq q qq q q q q q q qq q q q q q q qq q q q q q q q q q q q q q qq q qq q qq q q qq qq q q qq q qq q q q q q q qq q q q q q q qq q q q q q q q q q q q q q qq q qq q qq q q qq qq q q qq q qq q q q q q q qq q q q q q q qq qq q q q qq q qq q qq q q q qqq q q qq q q qq q qq q q q qqqqq q q q qq q q q q q q qq q q qq qq qq q q qq q qq q q q q q qq qq q q q qq q qq q qq q q q qqq q q qq q q qq q qq q q q qqqqq q q q qq q q q q q q qq q q qq qq qq q q qq q qq q q q q q qq qq q q q qq q qq q qq q q q qqq q q qq q q qq q qq q q q qq q q q q q q q q q qq q qq qq q qq qq qq q qq q qq q q q q q q qqq q q q q q q q q q qqq q q q q q q qqq q q qq q q q q q q q qqq q q q q q q qqq q q q q qq q qqq q q q q q q q q q qq q q q q qq q q q q q q q qqqqq q q q q qq q q q q q qq q q q qq q q q q q q q qq q q q q q q q qqq qq q q q q q q q qqqq q q qq qq q q q q q qq q qq q q q q q q q q q qq q q q q qq q q q q q q qqq qqq q q q q q qq q q q q q qq q q q qq q q q q q q q qq q q q q q q q qqq q q q q qqqq q q qq qq q q q q q qq q qq q q q q q q q q q qq q q q q qq q q q q q qqqqq q q q q qq q q q q qq q q q q q qq q q q qq q q q q q q q qq q q q q q q q qqq q qqq q q q q qqqq q q qq qq q q q q q qq q qq q q q q qq q q qq qq q q qq q q qq q q q q q q q q q qq q q q q q q qqq q q qq qq q q qq q q q q q q qq q q qq qq q q qq q q qq q q q q q q q q q qq q q q q q q q q qq q q q q q q qq q q qq qq q q qq q q qq q q q q q q q q q q q qq qq q qqqq qqq q q q qqq q q qq q q q q q qq q q q q qqqq q q q q q qqqq q q q qq q q q qq q q q q q qq qq q q q q qq q q q qq q q q q qq q qq q q q q qqqq q q q q q qqqq q q q qq q q q qq q q q q q qq qq q q q q qq q q q q qqq q q qq qq q qq q q q q qq q qq q q q q qqqq q q q q q qqqq q q q qq q q q q q q q q qq qq q q qq q q q q qq q q q q q q q q qq q q q q qq q q qq q qq qqq qqq q qqqq q q qqq qqq q q qq qqq q q q q q q qq q q q q qq q qq q q q q q q q qq q q q q qq q q qq q qq qqq qqq q qqqq q q qqq qqq q q qq qqq q q q q q q qq q q q q q q q q qq q q q q q q q qq q q q q qq q q qq q qq qqq qqq q qqqq q q qqq qqq q q qq qqq q q q q q q qq q q q q q qq q q qq q q q q q q q q q q q qqq qqq qqqqq q q qq q q q qq q qqq q q q q q q qq qq qq qqq qqqqq qqq q q qq q q q qq q q q qq q q q q q q q q q q q q qqq qqq qqqqq q q qq q q q qq q qqq q q q q q q qq qq qq qqq qqqqq qqq q q qq q q q qq q q q qq q q q q q q q q q q q q q q qqq qqq qqqqq q q qq q q q qq q qqq q q q q q q qq qq qq qqq qqqqq qqq q q qq q q q q q q qq q q q qq q q q q qq qq q q q q q q q q q q qq q qq qq q q q q q q q qq q q q q q q qq q q q q q qqqq q q q q q q q q qq q q q q q qqqqq qq q q q q q qqqq q q qq qq qqq q q q q q q q q q q q q q q qq q q q q q q q qq qq q q q q qq qq q q q q q q q q q q qq q qq qq q q q q q q q qq q q q q q q qq q q q q q qqqq q q q q q q q q qq q q q q q qqqqq qq q q q q q qqqq q q qq qq qqq q q q q q q q q q q q q q q qq q q q q q q q qq qq q q q q qq qq q q q q q q q q q q qq q qq qq q q q q q q q qq q q q q q q qq q q q q q qqqq q q q q q q q q qq q q qqqqq qq q q q q q qqqq q q qq qq qqq q q q q q q q q q q q q q q q qq q q q q q q q qq qq q q q q q qqq q q qq q qq qq qq q q q q q q q qq q qqqqqqqq qq qq qqqqq qq qq q qqq q qqqq qq qq qqq q qqq q qqq q q qq qq q q q q q q q q q q q q qq q q q q qqq q q q qqq q q qq q q qq qq q q qq q q q qq q qqqqqqqq qq qq qqqqq qq qq q qqq q qqqq qq qq qqq q qqq q qqq q q qq qq q q q q q q q q q q qq qq q q q q q qq q q qq q q q qqq q q q qqq q q q q qq q q q qq q qqqqqqqq qq qq qqqqq qq qq q qqq q qqqq qq qq qqq q qqq q qqq q q qq qq q q q q q q q q qq qq q q q q q q q q qq q q q q qq q q q q q q q q q q qq q q qq q q q q q q q q q q q q q qq q q q q q q q q q q q q q qqq q q q qq q q q qq qq q q q q q q qq q q q q q q q q qq q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q qqq q q q qq q q qq q q q q q q q q qq q q qq q q q q q q q q q q q q q qq q q q q q q q q q q q q q qqq q q q qq q q q qq qq q q q q q q qq q q qq q q q q qq qq q q qq q q q q q q qqq qqq qq q q q q q qq q q qq q qqq qqq qq qq qq qq q q q q qqq q q q qqq qq qq q q qq qq q q qq q q q q q qq qq q q q qq q q q q q q q q qq qq q q q q q q q q qq q q q q q qq qq q q qq q q q q q q qqq qqq qq q q q q q qq q q qq q qqq qqq qq qq qq qq q q q q qqq q q q qqq qq qq q qq q qq qq q q qq q q q q q qq qq q q q qq q q q q q q q q qq qq q q q q q q q q qq q q q q q qq qq q q qq q q q q q q qqq qqq qq q q q q q qq q q qq q qqq qqq qq qq qq qq q q q q qqq q q q qqq qq qq q q qq qq q q q q q q q qq q q q q qq q q q qq q q q q q q q q qq qq q q q q q q q q q q q q q q q q q q qq q qq q q q q q q qqq q qq q q q q q q q qq q q qqqq q qqqq q q q q q q q qq q q qq q q q qq q q q q q q q q q q q q qq q qq q q q q q qqq q qq q q q q q q q qq q q qqqq q qqqq q q q q q q q qq q q q q q q q qq q q q q q q q q q q q q qq q q q q q q q q qqq qqq q q q q qqq qqq q q qqqq q qqqq q q q q q qq q q qq q q q qq q qq q q q q q qq qq q q qq q qq q qqq q q q q q q q qq qqq q qqqq qqq q q q qqq q q q q q qq q q qqq q qq q q q q q q q q q q q q q qq q q q q qq q q q q q qq qq q q qq q qq q qqq q q q q q q q qq qqq q qqqq qqq q q q qqq q q q q q qq q q qqq q qq q q q q q q q q q q q q q qq q q q q qq q q q q q qq qq q q qq q qq q qqq q q q q q q q qq qqq q qqqq qqq q q q qqq q q q q q qq q q qqq q qq q q q q q q q q q q q q qq q q q q q q qq q q q q q q qq q q q q qq q q q q q q qq q q q q q q q q q q q qqq q q qq q qq qq q q q q q q q q q q qq q q q q q q q q q q q qqq q q qq q qq qq q q q q q q q q q q qq q q q q q q q q q q q qqq q q qq qq qq q q q q q q q q q q q q q qq q q qq q q qq q qq q q qq q q qqq q q q q q qqq q q qqqq q q qqqq qq q q q q q qqq qq qq q qq q qqq qqqqq q q q qqqqq qq qqq q qqq q qqqq q qq q qq qq q q q q q q qq q q q q qq q q q q q qq q q q qq q q qq q q qq q qq q q qq q q q q q q qqq q q qqqq q q qqqq qq q q q q q qqq qq qq q qq q qqq qqqqq q q q qqqqq qq qqq q qqq q qqqq q qq qqq q q qq qq q q q q q q qq q q q q qq q q q q q qq q q q qq q q qq q q qq q qq q q qq q q qqq q q q q q qqq q q qqqq q q qqqq qq q q q q q qqq qq qq q q q q qqq qqqqq q q q qqqqq qq qqq q qqq q qqqq q qq q qq qq q q q q q q qq q q q q qq q q q q q qq q qqq q qq q qq q qq qq q q q q q q q qqq qq qqq q q qqq q q q qq qq q qqqqqq qqq qq q qq q qq qq q qq qqqq q q q q q q q q q q q q qq qq q q qq q qq q qq q q q qq q q q q q qq q q q q q q qq q q q qq q qq q qqqq q q q q q q q q qq q q q q qqq q qq q qq q qq qq q q q q q q qqq qq qqq q q qqq q q q qq qq q qqqqqq qqq qq q qq q qq qq q qq qqqq q q q q q qq q q qqqq q q qq q qq q qq q q q qq q q q q q qq q q q q q q qq q q q qq q qq q qqqq q q q q q q q q qq q q q q qqq q qq q qq q qq qq q q q q q q q q qq qqq q q qqq q q q qq qq q qqqqqq qqq qq q qq q qq qq q qq qqqq q q q q q qq q q qqqq q q qq q qq q qq q q q qq q q q q q qq q q q q q q qq q q q qq q qq q qqqq q q q q q q q qq q q q q q q q q q q q q q q q q q q q qq q qq q q q q qq q qqqq qqq qq q q qqqq q q q qq q q q q q qqqqq q q q qq q q q q q q q qq q q qq qq q q q qq q q q q q q q q q q q q q q q q q q qq q qq q q q q qq q qqqq qqq qq q q qqqq q q q qq q q q q q qqqqq q q q qq q q q q q q q qq q q qq qq q q q qq q q q q q q q q q q q q q q q q q q qq q qq q q q q qq q qqqq qqq qq q q qqqq q q q qq q q q q qqqqqq q q q qq q q q q q q q qq q q qq qq q qq qq q q q qqq q q qqq q qqqqq qqq qqq q qqqq qq q q q qqqqq q q qq qq q qqqqqqqq q qqq q qq qq q q q q q q q q q qqq q q qqq q q q q q q q qq q qq qq q qq qq qq qq q q q qq qqq q q q qq qq qqqq q q q q q q q q qq q qq q q q q qq qq q q q q qqq q q qqq q qqqqq qqq qqq q qqqq qq q q q qqqqq q q qq qq q qqqqqqqq q qqq q qq qq q q q q q q q q q qqq q q qqq q q q q q qq q qq q q qq qqqq qq q q q qq qqq q q q qq qq qqqq q q q q q q q q qq q qq q q q q qq qq q q q q qqq q q qqq q qqqqq qqq qqq q qqqq qq q q q qqqqq q q qq qq q qqqqqqqq q qqq q qq qq q q q q q q q q q qqq q q qqq q q q q q qq q qq q q qq qqqq qq q q q qq qqq q q q qq qq qqqq q q q q q q q q qq q qq q q q q q q qq qq qq q q q q q q q q qqq q q q q q q q qq q q qq q qq qqq qq q q qq qq q q q q q q q q qqqqqqq q q qq qq qqqqqqqqqqqqqq qqq qq qq q q qq q q qq qq q qqq qq q q qq q q q q q qq q q qq q q qq q qq q q q q q qq qq q q qq q qq qq q q q q qq q q q q qq q q q q q qq q q q q qqq q q q q q q q qq q qqq q qq qqq qq q q qq qq q q q q q q q q qqqqqqq q q qq qq qqqqqqqqqqqqqq qqq qq qq q q qq q q qq qq q qqq qq q q qq q q q q q qq q q qq q q qq q qq q q q q q qq qq q q qq q qq qq q q q q qq q q q qq q q q q q qq q q q q qqq q q q q qq q qq q qqq q qq qqq qq q q qq qq q q q q q q q q qqqq qq q q qq qq qqqqqqqqqqqqqq qqq qq qq q q qq q q qq qq q qqq qq q q q qq q q q q q qq q q qq q q qq q qq q q q q q qq qq q q qq q qq qq q q q q qq q q q qq q q q qq q q q q q qqqq q q qq qq qq qq q q q qq q q q q q q q q q q qqq q qqqqqq q qqqqqqqqq q q q q q qq q q q qqq q q q q q q q q q q q q qq qq q q q q qq q qq q q q qq qq q q q q q qqqq q q qq qq qq qq q q q qq q q q q q q q q q q qqq q qqqqqq q qqqqqqqqq q q q q q qq q q q qqq q q q q q q q q q q q q qq qq q q q q qq q q q q qq qq q q q q q q q qqqq q q qq qq qq qq q q q qq q q q q q q q q q q qqq q qqqqqq q qqqqqqqqq q q q qq q q q qqq q q q q q q q q q q q q qq qq q q q q qq q qq q q qqq q q q q q q q q q qq q q q q q q q qq q qqqqq qq q qqqq qqqq qqqq qqqq qqq qq qq qqqq q q q qqqqq q q q q q q q q q qqqqq qqq q qqqqq q q qq q q q qqq q q qqqq q qq q q qq q qq q qq qqq q q q q q q q qq qq q qq q qq q q qqq q q q q q q q q q qq q q q q q q q qq q qqqqq qq q qqqq qqqq qqqq qqqq qqq qq qq qqqq q q q qqqqq q q q q q qq q qq q q q qqq q q qqqq q qq q q qq q qq q qq qqq q q q q q q q qq qq q q q q qq q q qqq q q q q q q q q q qq q q q q q q q qq q qqqqq qq q qqqq qqqq qqqq qqqq qqq qq qq qqqq q q q qqqqq q q q qq q q q qqq q q qqqq q qq q q qq q qq q qq qqq q q q q q q q qq qq q q qq q qq q qqq q q q q qq q q qq q q q q q qq q q q q q q q q qq qq qq qq q q q q qq qq q qq q qq q q q q q q q qq q qqqqqqq q qqq q q q q qq q q qq q qqq q qq q qq q qqq q q q q qq q q q q q q q q q q qqqq q qq q q qqqqq qqq q q qq q qqq qqq q qq qq q q q q q q q q q qqqq q q q q q qq q qq qqqq qq q q qqq qqq q q qqqqqq qqqq qqqq q q qqqqq qq qq q q q qqq q qqqq qqqq qq qqq q q q q q q q q q q q q q qq q q qqq q qq q qq q qqq q q q q q q q q q q q q qq q q q q q q q qqqq q qq q q qqqqq q q q q q qq q q q q qq q q q q q qq q q q q q q qq q qq qqqq qq q q qqq qqq q q qqqqqq qqqq qqqq q q qqqqq qq qq q q q qqq q qqqq qqqq qq qqq q q q q q q q q q q qq q qqqq q q qqq q q q qqq qqqq qq q qq q q q q q q q q q q q qq q q q q q q qq qq q q qqqqqq q qqq qqq q qqqq qqq q q qq qqqq q qq q q q q qq q q q q qq q q q q q qq qq qqq q q q q q q q qq q q qq q q qqq q qqq qqq qqq q qq q qq q q qq q qqqqqq q q qq q qq qqqq q qqqqq qq qq qqqqq qq q q q qqq qq qq qq qqqqq q q qq q q q q q q q q q qq q qq qq q q q q q q q q q qq q q q qq qq qq q qq q q qq q q q q q q q q q qq qqq q qqqqqqq q qq qqqqq q q q qq q q q qq q q q q q q q q q q qq qq q q q q q q q q qq q q qqq qq q qq qq q q qq q q q q qq qq q qqqqqqq q qq qqqqq q q q q qq q q q qq q q q q q q qq qq q q q qq qqq q q qqq qq q q q q q q qq q q q qq qq q qqqq q qq q q q q q qq q qq q q q qqq q qqq q qq q q qq qq q q q q q q q q qqq q q q q q q q q qq qq q q q q qq q q q q q q q q qq q q qq q qq qqq q qqq q q qq q q qqq q qq qq q qq q q qq q qq qqq q qqq q q q qq q qq qq q q q qqq q q qq q q q qq qqqq q qqq q q q q qq qq q qq qq qqq qqqq q q q qq q q q qq q q q q q q q q q qq q q q q q q q q qq q q qq q qq qqqq qqq q q qq q q q q q qq qq qqq qq q qq q q qq q qqq q q qqq qqqq q q qqq qq q q q q qq q q q q q q q q qq qq q q q q q q qq q q q q qq q q qq q q qq q q q q q qqq qq qq q q q qq qq q q q q q q q qq qqq qq q qqqqqqq qqqqqq qqqq qqq qqqqqq qq q qq qq qqq q q q q qq q q q q q qq qqqq q q q q q qq q q qq q q qq q q qq q q qqqqqq qqq qq q qq q q q qq qqqq q q q q q q qq q qq q q q q q qq q q q q qq qq q q qq qq q q q q q q qq q q q q q q q q qq q q q qq q q q q q q qq q q q q q q q q qq qqq qq q qqqqqqq qqqqqq qqqq qqq qq qqqq qq q qq qq qqq q q q qq q q q q q qq qqqq q q q q q qq q q qq qq q q qq q q qq q q qqqqqq qqq qq q qq q q q qq qqqq q q q q q q qq q qq q q q q q q q qqq q q q q q qq qq q q q qq qq q q q q q qq q q q q q q q q qq q q q qq qqqq q qqqqq q q qq qqqqqqq q q q q q q q q q qqqqq q qq qqqqq qq q qq q q q qq q q q qq q q q q qqq qq qqq q q q q q q q qq q q q q q q q q qq qqq qq q qqqqqqq qqqqqq qqqq qqq qq qqqq qq q qq qq q q q q q q q q q qqq qq q q q q qq qq q q q q q q q q q qq qq q q q q q q qqq q qqq q q q q q qq q q q q qq q q qq q q q qq qqq q qq qqq q q qq q q q q q q q q q q q q q qq q q q q q q qq q q q q q q q q qq q q q q q q q q q q qq qq q q q q q q qqq q qqq q q q q q qq q q q q q qq q q q qq q q q qqq q qq qqq q q qq q q q q q q q q q q q q q qq q q q q q q q qq q q q q q q q q qq q q q q q q q q q q qq q q qq q qq q q q q q q q q qq q q q q q q q qq qq q q q q q q q q q q q q q q q qqq qq q qqq qq qqq q q q qq q q q q q q q q q qq q qqqq q q q qq q q q q q qq q q q qq q q qq q q q q q q qq qq q q q qq q q q q qq q q q qqq qq q qq qqq q qq qqq q qqqqqq qq qqqqq qq q qqqq q q qqq q q qq q q q q qqqq q qqq q qqq q q qq qq q q q qqq q q qq qq q q qq qq q qq q qq qq q qq qq q q q q q q q q q q q q q qqq q q q q q q qq qq q q q q q q q q q qq q qqq q q qq qq q q q qq q q q q qq q q q qqq qq q qq qqq q qq qqq q qqqqqq qq qqqqq qq q qqq q q q qqq q q qq q q q q qqqq q qqq q qqq q q qq qq q q q qqq q q qq qq q q qq qq q qq q qq qq q qq qq q q q q q q q q q q q q qqq q q q q q q qq qq q q q q q q q q q qq q qqq q q qq q qq q q q q qqq q q q q q qq qq qqq q q qq q q qq q qqq q q q q q q q qq q q q qqq qq q qq qqqq qq q qq q qqqqqq qq q qqqq qq q qqqq q q qqq q q qq q q q q qqqq q qqq q qqq q q q qq q q qq q q q q q qq qq qq qq qq qq q qqq qq q qq q qq q q q q q q q q q q q q q q q qq q q q q q q q qqq q q q q qq q qqqq q q q q q q qq q q q qq q q qq q q q q q q q q qqqq qq q qq q qq q q qqq q q qq q q q q qq q q q qq q q q q qqqqq qq q q q q qqq q q q qqqqq q qqqqqq q q qq q qq q q qqq q qqqq q qqq q q q q q q qq q qq q q q q q q qq qqq q q q q q qq q qq q qq q q q qq q qqqq q q q q q q qq q q qq q qq q q q q q q q q qqqq qq q qq q qq q q qqq q q qq q q q q qq q q q qq q q q q qqqqq qq q q q q qq qq q q qqqqq q qqqqqq q q qqq q qq q q qqq q qqqq q qqq q q q q q q qq q qq q q q q q q qq qqq q q qq q qq q q q qq q q qqqqq q q q q qq qq q q q qq q q q q q qq q qq qq q q qq qq q qqqqqq q qqqqqq q q qq q qq q q qqq q qq qq q qqq q q q q q q q q q q q q qqqq qq q qq qq q q qqq q q qq q q q qq q q qq q qq q q q q q q qq qqq q qq q q qq q qq q q q q qq q q q q q q qqq qq qqqq qq q q q q qq q q qq qq q q q qqq qqqqqqqq qq q qqq q q q q q q q q q qq q q q q qq q q q q q qq q q qq q q q q q q qq q q q q q q q q q qqq qq qqqq qq q q q q qq q q qq qq q q q qqq qqqqqqqq qq q qqq q q q q q q q q q qq q q q q qq q q q q q qq q q q q qq q q qq q q q q q q qq q qq q q qqq qq qqqq qq q q q q qq q q q qq q q q qqq qqqqqqqq qq q qqq q q q q q q q q q qq q q q q qq q q q q qq q q q q qq qq qq q q q q qq q q q q q q q qq q q q q q q q q q q qq q q qq q q qq qq q q qqqq q qqq qqqqqqqqqqqqqqqqqqqqq qqq qq qqqqqq q q q qq qq qq qq qq q qq qq q q q q q q q q q q qq q q q q qq q q q qq q q q q q q q q q q q q q qq q q q q q q q qq q q q q q q q q qq q qq q q qq q q qq qq q q qqqq q qqq qqqqqqqqqqqqqqqqqqqqq qqq qq qqqqqq q q q qq qq qq qq qq q qq qq q q q q q q q q q q q q q q qq q q q qq q q q q q q q q q q q q q qq q q q q q q q qq q q q q q q q q q q qq q q qq q q qq qq q q qqqq q qqqqqqqqqqqqqqqqqqqqqqqqq qqq qq qqqqqq q q q q q q qq qq qq q qq qq q q q q q q q q q q q q q q q q q qq q q q q q q qq q q q q q q qq q q q q q q q q q q qq q q q q q qq q q q qqq qq q q q qqqq q q q q q q qq q q q qqq qq q qq q q q q q qq q q qqqqq q qq qqqq q qqqq qqqq qq q qqq qqqqqqqq q qq qqqqqq q q q qq q q qq qq q qq qq qqqqq q qqq q q qq q q qq q q q q q qqqqq q qq q qqqq q qq qqq q qqq qqq q qq qq qqqq q qq q qq q qqq q q q q qqqq qq q q q q q qq q q qq q q q q q q q q q q q q q q q q qq q q q q q qq q q q qqq qq q q q qqqq q q q q q q qq q q q qqq qq q qq q q q q q qq q q qqqqq q qq qqqq q qqqq qqqq qq q qqq qqqqqqqq q qq qqqqqq q q q qq q q qq qq q qq qq qqqqq q qqq q q qq q q qq q q q q q qqqqq q qq q qqqq q qq qqq q qqq qqq q qq qq qqqq q qq q qq q qqq q q q q qqqq qq q q q q q qq q q qq q q q q q q q q q q q q q q q q qq q q q q q qq q q q qqq qq q q q qq qqq q q q q q qq q q q qqq qq q qq q q q q q qq q q qqqqq q qq qqqq q qqqq qqqq qq q qqq qqqqqqqq q qq qqqqqq q q q qq q q qq qq q qq qq qqqqq q qq q q qq q q q q q qqqqq q qq q qqqq q qq qqq q q qq qqq q qq qq qqqq q qq q qq q qqq q q q q qqqq qq q q q qq q q q q qq q q qq q q q q q q q qq q q qq q q q q q q q q qq q q q q q q q q q qq q q qq q qqq q qq qq q q qqq qqqq q q q q qqq q qq q qqqq q qq q q qqq q q q q qqqq q qqqqqqq qqqqqqqq qq qq qqq q qqqqqqq q qq qq qq qqqqqqqqqq q qqqq qqqq qqq q q q qq qq q q q qq qq q qqq q qq q q qq qqqq qq q q q q q q q q q q q q qq q q q qq q q qq q q q q q q q q qq q q q q q qq q q q qq qq q q q q qq q q q q qq qq q q qqq qqqq q q q q qqq q qq q qqqq q qq q q qqq q q q q qqqq q qqqqqqq qqqqqqqq qq qq qqq q qqqqqqq q qq qq qq qqqqqqqqqq q qqqq qqqq qqq q q q qq qq q q q qq qq q qqq q qq q q qq qqqq qq q q q q q q q q q q q q qq q q q qq q q qq q q q q q q q q qq q q q q q q q q q qq qq qq q qqq q qq qq q q qqq qqqq q q q q qqq q qq q qqqq q qq q q qqq q q q q qqqq q qqqqqqq qqqqqqqq qq qq qqq q qqqqqqq q qq qq qq qqqqqqqqqq q qqqq qqqq qqq q q q qq qq q q q qq qq q qqq q qq q q qq qqqq qq q q q q q q q q q q q q qq q q qq q q q q q q q qqq q q q q q qq q q q qqq q qq q q qq q q qq q qq qq q q q q q q q q qqqqqq qqq q qqqqqqqqqqqqqqq q qqqqqq q qqq q q q q q q q q q q q qq qq q q q qq q qq q qq q q qq q q q q qqqq q q q qq q qq q qqq qq qq qqqqq q qqq q q qq q q qq q q qq q q q q q q q qqq q q q q q qq q q q qqq q qq q qq q q qq q q q q qq qq q q qq q q q qqq q q q q q qq qq q q qqqqqq qqq q qqq qqqqqqqqqqqq q qqqqqq q qqq q q q q q q q q q q q qq qq q q q qq q q qq q q qq q q q q q q q qqq q q q q q qq q q q qqq q qq q q qq q q qq q qq q qq qq qq q q q q q q q q qqqqqq qqq q qqqqqqqqqqqqqqq q qqqqqq q qqq q q q q q q q q q q q qqqqq q q qq q q qq q q q q qqqq q q q qq q qq q qqq qq qq qqqqq q qqq q q q q q q q q q q q q q q qq q q q q q q q q q q q q q qq qq q q q q qq qqq qq q qqqqqqqqqqqqqqq q qq qqqqqq q q qq qqq qqqq qq q qq q qq qq qq qq q q qqqq q q q q q q q qqq q q q qq q q q q q q q qq q qq qq qq qq q qq q q q q q q q q q q qq q q q q q q q q q q q q q q qq q q q q q q q q q q q q q qq qq q q q q q qq qqq qq q qqqqqqqqqqqqqqq q qq qqqqqq q q qq qqq qqqq qq q qq q qq qq qq qq q q qqqq q q q q q qqqq q q q q q q q q qqq q q q q q q q qq q q q q q qq qq q qq qq q qq qqqqq q q q q q q qq q q q qq q qq qq q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q qq qq q q q q qq qqq qq q qqqqqqqqqqqqqqq q qq qqqqqq q q qq qqq qqqq qq q qq q qq qq qq qq q q qqqq q q qq q q q q qqq q q q qq q q q q q q q q qq q qq qq qq qq q qq q q q q q q q q q qq q q q q q q q q qq qq q q q q q q q q q q q q q qqq qq q q q q q q q q q q q q qq qq q q q q q qq q q q q qq qq q qq qqqqq qqqqq qq qqqqqqq qqqqqqq qq qq q qqqqq qq q qq qqq qqqqq q qq q qqq qqqq q q q q qq q qqq q q qqq qq q q q qq qq q q q q q qq q qqqqqq qq qqqq q q qqqqqqq qq qq q qq q qq q q q qq q qq q q qq qq qq q qqq qq qq q q qq q q qq q q q q q q q q qq qq q q q q q q q q q q q q q qqq qq q q q q q q q q qq q q qq qq q q q q q q qq q q q q qq qq q qq qqqqq qqqqq qq qqqqqqq qqqqqqq qq qq q qqqqq qq q qq qqq qqqqq q qq q qqq qqqq q q q q qqq qq q qq q qqq q q qqq qq q q q qq qq q q qq q qqqqqq qq qqqq q q qqqqqq q qq qq q qq q qq q q q qq q qq q q qq qq qq q qq q q q q q q qq q q q q q q q q qq qq q q q q q q q q q q q q qqq q q q q q q q q q q qq qq q qq q q q q q qq q q q q q qqq q qq qqqqq qqqqq qq qqqqqqq qqqqqqq qq qq q qqqqq qq q qq q q qqqqq q qq q qqq qqqq q q q q qqq qq q qq q qqq q q qqq qq q q q qq qq q q q q q qq q qqqqqq qq qqqq q q qqqqqq q qq qq q qq q qq q q q qq q qq q q qq qq qq qq q q q q q q qq q q q q q q q q q qq q q q q q q qq q q q q q q qq qq qq q qq q q q qq qq q q q q q qq q q q q q qq qq q q q qq q q qq q q q q q q qq q q q q q q qq qq qq q qq q q q qq qq q q q q qq q q q q q qq qq q q q qq q q qq q q q q q q qq q q q q q q qq qq qq q qq q q q qq qq q q q q qq q qq q q q q qq q q q qq q q qq q qq qq q qqq q q qqqq q q q q q q q qq qqq qqqq qq q qqq qqq q qq qqq q qqq qqqqqq qqq qqq qqq qqqq q qqqqq q q q q q q qq qq q q q qq qq q q q qq qqq q qq q qq qq q q qqq qq q q q q q q q q q qqq q qq q q qq q q q q qq qq qqq q q qq q q q qq q q qq q qq qq q qqq q q qqqq q q q q q q q qq qqq qqqq qq q qqq qqq q qq qqq q qqq qqqqqq qqq qqq qqq qqqq q qqqqq q q q q q q qq qq q q q qq q q q qqq q qq q q q qq qqq q qq q qq qq q q qqq qq q q q q q q q q qq q q qq q q q q qq qq qqq q q qq q q q q q q q qq q qq qq q qqq q q qqqq q q q q q q q qq qqq qqqq qq q qqq qqq q qq qqq q qqq qqqqqq qqq qqq qqq qqqq q qqqqq q q q q q q qq qq q q q qq qq q q q qq qqq q qq q qq qq q q qqq qq q q q q q q q q q qqq q q q qq q q qq q q q q qq qq qqq q q qq q q q q q q qqq q q q q q q q q q q q q q q q q q qq qq qqqqqqqqq qqq qq q qq qqq qq q qqq q q q q qq q q q q qq q qq qq q q q q q q q q q qq q q qq q qq q q q q q q q q q q q q q q q qqq q qq qq q qqq qq qq qqqqq qqqq qq q qqqqqqqqq qqq q qqqqqqqqqqq q qqqqqqq qqq qq q q q qq q q q qqq q qqq q qq qq q qq qq q q q qqq q q q q q q q q q q q q q q q q q qq qq qqqqqqqqq qqq qq q qq qqq qq q qqq q q q q qq q q q q qq q q q qq q q q q q q q q q qq q q qq q qq q q q q q q q q q q q q q q q qqq q qq qq q qqq qq qq qqqqq qqqq qq q qqqqqqqqq qqq q qqqqqqqqqqq q qqqqqqq qqq qq q q q qq q q q qqq q qqq q qq q q q qq q q q q q qqq q q q q q q q q q q q q q q q q q qq qq qqqqqqqqq qqq qq q qq qqq qq qq qqq q q q q qq q q q q qq q q q qq q q q q q q q q q qq q qq q q q q q q q q q q q q q q q qqq q qq qq q qqq qq qq qqqqq qqqq qq q qqqqqqqqq qqq qq qqqqqqqqqq q qqqqqqq qqq qq q q q qq q q q qqq q qqq q qq qq q qq q qq q q q q q q q q q qqq q qq q q q q q q qq qqq qq q qq q qq q q q q q q q q q q qqq q q q q qqqq qq q q q qqqqq qqqqqq q q q q q qqqqq qqqq q q q q q q q q q q q q q qq q qq q qqq q q q q q q qq q qqq qqq q qqqq q qq qqqq qq q qqqqqq qqqqqqqq q q qq qq q qq q qqq q qqq q q q qq qq q q q qq q q qq q qq q q q q q q q q qqq q qq q q q q q q qq qqq qq q qq q qq q q q q q q q q q q qqq q q q q qqqq qq q q q qqqqq qqqqqq q q q q q qqqqq q qqqq q q q q q q q q q q q q q qq q qq q qqq q q q q q q qq q qqq qqq q qqqq q qq qqqq qq q qqqqqq qqqqqqqq q q qq qq q qq q qqq q qqq q q qq qq q q q qq q q qq q qq q q q q q q q q qqq q qq q q q q q q qq qqq qq q qq q qq q q q q q q q q q q qqq q q q q qqqq qq q q q qqqqq qqqqqq q q q q q qqqqq q qqqq q q q q q q q q q q q q q qq q qq q qqq q q q q q q qq q qqq qqq q qqqq q qq qqqq qq q qqqqqq qqqqqqqq q q qq qq q qq q qqq q qqq q q qq qq q q q qq q q qq q qq q q q q q qq q q q q q qq q q qq qq qq q q q q q q qq q q q q qq qq q qq q q qqqq q q q q q q q q q q q q qq q q qq q q q qqq q q q q q qq qqq q q q q q qq q q qq q q q q qq qqqqqq qq qq q q qqqqq qqqq q qqqqqqqqqqqq qq qqqqq qqq q qqqqq q qq qq qq qqqq q qq qq qq q q qq q q q q q q q q q q q qq q q q q q qq q q qq qq q q q q q qq q q q q qq qq q qq q q qqqq q q q q q q q q q q q q qq q q qq q q q qqq q q q q q qq qqq q q q q q qq q q qq q q q q qq qqqqqq qq qq q q qqqqq qqqq q qqqqqqqqqqqq qq qqqqq qqqq qqqqq q qq qq qq qqqq q qq qq qq q q qq q q q q q q q q q q qq q q q q q qq q q qq qq qq q q q q q q q q q q qq qq q qq q q qqqq q q q q q q q q q q q q qq q q qq q q q qqq q q q q q qq qqq q q q q q qq q q qq q q q q qq qqqqqq qq qq q q qqqqq qqqq q qqqqqqqqqqqq qq qqqqq qqq q qqqqq q qq qq qq qqqq q qq qq qq q q qq q q qq q q q q q q qq q q qq q q q q q q qq q q q qq qqq q qq qqq q q qqq q qqqq qq q q q q qq qq qq qq qqq q qqqq qq q q q q q qq q qq q q q qq q q q q q q q q qq q q q q qqqqq qqq qq qq qqqqqq qqqqqqqqqq qqqqq qqqqqqq qqqqq q q qqq q q qqq q qqqqq qqq q qqqq q q q qq q q qq q q qq q q qq q q qq q q q q q q qq q q q q q q qq qqq q qq qqq q q qqq q qqqq qq q q q q qq qq qq qq qqq q qqqq qq q q q q q qq q qq q q qq qq q q q q q q qq q q q q qqqqq qqq qq qq qqqqqq qqqqqqqqqqqqqqq qqqqqqq qqqqq q q qqq q q qqq q qqqqq qqq q qqqq q q q qq q q q q q q qq q q qq q q q q q q qq q q q qq qqq q qq qqq q q qqq q qqqq qq q q q q qqqq qq qq qqq q qqqq qq q q q q q qq q qq q q q q q q q q q q q q qq q q q q qqqqq qqq qq qq qqqqqq qqqqqqqqqq qqqqq qqq q qq qqqqq q q qqq q q qqq q qqqqq qqq q qqqq qq q q q qq q q q q q q q q q q q q q qq q q q qq q q q q q q q q q qq q qqq q qq q q q qq qq q q q q q q qq qq qq q q qqq qqqqqqq qq qq q q qq q q qq q q qq qq qq q q q q q q q q q q q q qq q q q qq q qq q q q q q q q q q qq q q q qq q q q q q q q q q q q q qq q qqq q qq q q q qq qq q q qq q q q q q qq qq q q q q qqq qqqqqqq qq qq q q qq q q qq q q q qq qq q q q q q qq q q q q q q q qq q q q qq q qq q q q q q q q q q qq q q q qq q q q q q q q q q q q q qq q qqq q qq q q q q qqq q q q q q q q qq qq qq q q qqq qqqqqqq qq qq q q qq q q qq q q qq qq qq q qq q q q q q q q q q q qq q q q qq q qq q q q q q qq q q q q q qq q qq qq q q qq q q q qq q qq qqqqqq qqqqqq qqqqqqq qqqqqq q qq qqqq qq q q q qq qq qqqq q q qqq qqqqq q q q q q q q qq qq q q q qqqq qq qq q qqqqqqqqqq qqq q qq q qq qqqqqqq qqqq qqqq qq q qqqqqq qqq q q q qq q q q qq q q qq q q q qq q qq q q qq q qq qqq q qqq qq q q q qq qq qq q q q qq q q q q q qq q qq qq q q qq q q q qq q qq qqqqqq qqqqqq qqqqqqq qqqqqq q qq qqqq qq q q q qq qq qqqq q q qqq qqqqq q q q q q q q qq q q q qqqq qq qq q qqqqqqqqqq qqq q qq q qq qqqqqqq qqqq qqqq qq q qqqqqq qqq q q q qq q q q qq q q qq q qq q qq q qq q q qq q qq qqq q qqq qq q q q qq qq qq q q q qq q q q q q qq q qq qq q q qq q q q qq q qq qqqqqq qqqqqq qqqqqqqqqqqqqq q qq qqqq qq q q q qq qq qqqq q q qqq qqqqq q q q q q q q qq qq q q q qqqq qq qq q qqqqqqqqqq qqq q qq q qq qqqqqqq qqqq qqqq qq q qqqqqq qqq q q q qq q q q qq q q qq q q qq q qq q q qq q qq qqq q qqq qq q q q qq qq qq qq qqq q q qqq q q q qq q q q q qq q q q q qq q q q q q q qqq q q q qq qq q qq q q q q q qq q q q qq qqq qq q qq q qq qq qqq q qqq qqq q q q qq q q q q q q q q qq q q qq q qq q q qq qqqqq q q q qq q qqqq qq qqqqq q qq qqqqqqq q qq qq qqqq q q q q q q q qqq qq qq q qq qq q qq q q q qq q qq qqq q q qqq q q q qq q q q q qq q q q q qq q q q q q q qqq q q q qq qq q qq q q q q q qq q q q qq qqq qq q qq q qq qq qqq q qqq qq q q q qq q q q q q q q q qq q q qq q qq q q qq qqqqq q q q qq q qqqq qq qqqqq q qq qqqqqqq q qq qq qqqq q q q q q q q qqq q q q q qq qq q qq q q qq q qq qqq q q qqq q q q qq q q q q qq q q q q qq q q q q q q qqq q q q qq qq q qq q q q q q qq q q q q qqq qq q q q q qq qq qqq q qqq qqq q q q qq q q q q q q q q qq q q qq q qq q q qqqqqqqq q q q qq qqqq qq qqqqq q qq qqqqqqq q qq qq qqqq q q q q q q qqq q qqqq q qq qq q qq q q qq q qq q q q q q q q q q q q q q q qqq qq qq q qqq qqq q qq qq q qq qq q q q qq q qq qq q q q qq qq q q q q q qq qqq q q qqqq qq qqqq qq qqqq qqqqqqqq qq q qq qq qqqq q q qq q q q q q q q q q qq qq q q q qq q q q q q q q q q q q q q qqqq qq qq q qqq qqq q qq qq qq qq q qq q q q qq q qq qq q q q q qq q qq q q q q q qq qqq q q qqqq qq qqqq qq qqqq q qqq qqq qq q qq qq qqqq q q qq q q q q q q q qq qq q q q q q qq q q q q q q q q q q q q q qqq qq qq q qqq qqq q qq qq qq qq qq q q q qq q qq qq q q q q q qq q q q q q qq qqq q q qqqq qq qqqq qq qqqq qqqqq qqq qq q qq qq qqqq q q qq q q q q q q q q q qq qq q q q q q qq q q q q qqq qqq qqqqqqq q qq qqqqq qqqqqqqqqq qqq qqq qqqq qqqqqqqq qqq q q qq q qqq q qqqq qq q qq q qqq q q q q q q q q q qq qqqqq qq q q q q q q qq qq q q q q qqq qqq qqqqqqq q qq qqqqq qqqqqqqqqq qqq qqq qqqq qqqqqqqq qqq q q qq q qqq q qqqq qq q qq q qqq q q q q q q q q q qq qqqqq qq q q q q q q qq qq q q q q qqq qqq qqqqqqq q qq qqqqq qq q qqqqqq qqq qqq qqqq qqqqqqqq qqq q q qq q qqq q qqqq qq q qq q qqq q q q q q q qq q q q q q qq qq q q q q qq q q q qq q q qq q qq qqqq q q qq qq q q q qqq q q q q q q qq q q q q q q q q q q q qq q q qq q q q q q qq q q q q q qq qq q q q q qq q q q qq q q qq q qq qqqq qq qq q q q q q q qq qq q qq q qq q q q q q q q q q q q q q q q q q q q q q q qq q q qq q q q q q q qq q q q qq q q q q qq q q q qq q q qq q qq q q q q q q q qq qqqqq qq q q q q q q qq q qq q q q q qq q q qq q q q q q q q q q q q q q qq q q q q q q q qq qq q qq q q q q q q q qq qq q qq q q q qq q q q q q qq q q qqqqqqq qq qqq q q q q q qq q q q q q q q q qqq q qqqqqq q qqqq qqqqqqqqqqq q qq qqqq q qq q q q qq qqq qqqqq qq q qqq qq q qqqqqqqqq qq qq q qq qq qqqq q qqq qq qq q q q q q q q q qq qq qq q q q q q q q q q qq q q qq qqq q q qq qq q q q q q qq qq q qq q q q q q q q qq qq q q q q q q qq q q q q q q qq qqq qqqqq qq q qqq qq q qqqqqqqqq qq qq q qq qq qqqq q qqq qq qq q q q q q qq q q qqqqqqq qq qqq q q q q q q q q q qqq q qqqq q q qqqq qqqqqqqqqqq q qq qqqq q q q q q q q q qq q q qqq q q q q q q qq q q qq qqq q q qq qq qq q q q qq qq q qq q q q qq q q q q q qq qq qq q q q q q q q qq qqq q q q q qqq q q q q q qq q q q q q q qq qq qq q q q qq q q q q qq qqq qqqqq qq q qqq qq q qqqqqqqqq qq qq q qq qq qqqq q qqq qq qq q q q q q qq q q qqqqqqq qq qqq q q q q q q q q q qqq q qqqqqq q qqqq qqqqqqqqqqq q qq qqqq q q q q q q q q qq q q qq qqq q q qq qq qq q qqq qqq q q q q q qq q q q q q q q q qq q q q qqq q q q q q q q qq qq q q q qq q q q q q q qq q q q q q q qqqq q q qq q q q q qq qq q q q q qqq q qqqq qqqqqqqq qqqqqq qqqqqq q q q qq q q q qq q q qqq qq q q qq q q q q qqq qqq q q q q q qq q q q q q q q q qq q q q qqq q q q q qq q q q qq q q q q qq q q q q q q qqqq qq qq q q q q qq qq q q q qqq q qqqq q qq qq qqq qqqqqq qqqqqq q q q qq q q qqq q qq qqq qq q q qq q q q q qqq q q q q q q qq q q qq qq q q q qq q q q qqq q q q q q q qq qq q q q qq q q q q q q q qq q q q q q q qqqq q q qq q q q q qq qq q q q qqq q qqqq qqqqqqqq qqqqqq qqqqqq q q q qq q q q qq q qq qqq qq q q qq q q q q q qq qq qq q q q qqqq q q q qq q qq q qq qq qq q q q qq q q q q qqq qqqqqqq qqq q q qq qqq qqqqq q qqq qqqqqq qqq qq q qq q q qq q q qq q q q q q q q q qq q q q qq q q qq qq qq q q q qqqq q q q qq q qq q qq qq qq q q q q qq q q q q qq q q q q qqq qqqqqqq qqq q q qq qqq qqqqqq qqq qqqqqq qqq qq q qq q q qq q q qq q q q q q qq q qq q qq q q qq qq qq q q q qqqq q q q qq q q qq qq qq q q q qq q q q q qqq qqqqqqq qqq q q qq qqq qqqqq q qqq qqqqqq qqq qq q qq q q qq q q qq q q q q q q q q qq q q q qq q q q qq qq q q q q q q q q q q qq q qq qq q q q q q q qq q qq q q qqq q q q q qq q q q q qqq qqq q qq qq q q q q q q q q q q q qq q qq q q q qq qq q q q q q q q q q q qq q qq qq q q q q q q qq q qq q q qqq q q q q qq q q q q q qq qqq q qq qq q q q q q q q q q q q q q qq q qq q q q qq qq q q q q q q q q q q qq q q qq qq q q q q q q qq q qq q q qqq q q q q qq q q q q qqq qqq q qq qq q q q q q q q q q q q qq q qq qq q q q q q q q q q qq q q q qq q q qq q qq q q qqq q qq q qqq qq qq q q qq q qq q q q q q q q q q q q q q q qq q q q q q q q q qqq qqqqqqq qqqqq qqq qqqqqqqq q q qqq qqq q q q q qq q qq q q q q q q q q qq q qq q q q q q q q qq qq q q q q q q q q q qq q q q qq q q qq q qq q q qqq q qq qqq q qq qq q q qq q qq q q q q q q q q q q q q q q qq q q q q q q q q q qqq qqqqqqq qqqqq qqqqqqq qqqq q q qqq qqq q q q q qq q qq q q q q q q q q qq q qq q q q q q q q qq qq q q q q q q q q qq q q q qq q q qq q qq q q qqq q qq q qqq qq qq q q qq q qq q q q q q q q q q q q q q qq q q q q q q q q q qqq qqqqqqq qqqqq qqq qqqqqqqq q q qqq qqq q q q q qq q q qqqq q q q q q q q q q q q q qq q q q q qq q qqq q q qq q qq q q q q q q q q q qqq qq qq q q q q qq q q q q q q qq qq q qq qqq q qqq q q qq qq qq q q q q q qqq qqq q qq qqqq q q q qq q qqq q q q qq q q q q q q qq q qqq q q qq q qq q q q q q q q q q qqq qq qq qq qq q q q q q q qqq qq q q qqq q qqq q q qq qq qq q q q q q q qqq qq q qq qqqq q q q qq q qqq q q q qq q q q q q q qq q qqq q q qq q qq q q q q q q q q q qqq qq qq q q q q qq q q q q q q qq q q q qq qqq q qqq q q qq qq qq q q q q q qqq qqq q qq qqqq q q q qq q qqq q q qq q q q qq q q q q qq qq q qq qq qq q q q q q q qqqq q q q qq q q q qq q q q qqq q q q q q q q q qqqq q q qqq q qqqqqqqqqqqqqq q qqqq qq qqq qq q qqq q q q qqq q q qq q q q qq q q qq qq q q qq q q q q qq q q q qq qq q qq qq qq q q q q q q qqqq q q q qq q q q q q q qq qq q qqq q q q q q q q q qqqq q q qqq q qqqqqqqqqqqqqq q qqqq qq qqq qq q qqq q q q qqq q q qq q q q qq q q qq q qq q qq q qq q q q qq qq q qq qq qq q q q q q q qqqq q q q qq q q q qq q q q qqq q q q q q q q q qqqq q q qqq q qqqqqqqqqqqqqq q qqqq qq qqq qq q qqq q q q qqq q q qq q q q qq q q qq qq q q q q qq q qq q qqq q q qq q qq q q qq q q q q q q q q qq qqqqq qq q qq q qqqqq q qqqqq q q q q q qqq q q q q q q q qq qq q q q q q qq q qqq q qqq qq q q q q q q q qq q qq qq q qqqqqq q q qq qq q qqqq qqqq qqq qqqq q qq q q qq q q q qqq q qq qq q q q qqq qq q q q q q qq q qq q q qq q q q q q q qqq q q qq q qq q q qq q q q q q q q q qq qqqqq qq q qq q qqqqq q qqqqq q q q q q qqq q q q qq q q qq qq q q q q q qq q qqq q qqq qq q q q q q q q qq q qq qq q qqqqqq q q qq qq q qqqq qqqq qqq qqqq q qq q q qq q q q qqq q qq qq q q q qqq qq q q q q qq q q qq q q q q q q qqq q q qq q qq q q qq q q q q q q q q qq qqqqq qq q qq q qqqqq q qqqqq q q q q q qqq q q q qq q q qq qq q q q q q qq q qqq q qqq qq q q q q q q q qq q qq qq q qqqqqq q q qq qq q qqqq qqqq qqq qqqq q qq q q qq q q q qqq q qq qq q q q qqq qq q q qq q qq q q qq q q q q q q q q q q qq qq q qqq q q q qq q q q q q qq qq q q qq qq q qq q qq qq q qq q q qq q q qq qq q q qq q q q q q q q q q q qqq q q q q q qq qq qq q q q q qq q qq q q q q qq qq q qqq q q q qq q q q q q q q qq qq q q qq qq q qq q qq qq q qq q q qq q q qq qq q q qq q q q q q q q q q q qqq q q q q q q qq q q q q qq q q q q qq q qq q q q q qq qq q qqq q q q q qq q q q q q q q qq qq q q qq qq q q q q qq qq q qq q q qq q q qq qq q q q q q qq q q qq q q qqq q q q q q qq q q q q qq q q q q qq q qq q q q q q qq q q q q q q q qq q q q q q qq q q q q qq q q qq qq qq q qq q q qq q q q qqqqqqqq qqq q qq q q qq q qq q qq qq qqqqq qq q q q q q qq q qq q q qq q q qq q q q q qq qq q q q qq q q q qq qq q qq q q q qq q q q q q q q qq q q q q q q q qq q q q q q qq q q q q qq q q qq q q qqq qq qq q q qq q q q qqqqqqqq qqq q qq q q qq q qq q qq qq qqqqq qq q q q q q q qq q q q q qq q q q q qq qq q q qq qq q q qq q qq qq q qq q q q qq q q q q q q q qq q q q q q q q qq q q q q q qq q q q q qq q q qq q q qqq qq qq q q qq q q q qqqqqqqq qqq q qq q q qq q qq q qq qq qqqqq qq q q q q q q qq q q q q qq q q q q qq qq q q qq qq q qq qq q qq q q q qq q q q q qq q q q q q q q q q qq q q q q qq q q qq qq q qq qq q qq qq qqq q q q qq q q q q q q q q q q qq q q q q q q q q q qq q q q q qq q q qq q q q qq q qq q q q q q qq q q q q q q q q q q q q q q qq q q q q q q q q q q qq q q q q qq q q qq qq q qq q qq q q qq q q qq q q q q q q q qq q q q q q q q q qq q q q q q q q qq q q qqq q q q qq q qq q q q qqq qqqqq qq q q q q q qqqq q q q q q q qq qq q q qqq q q qq q q q q q qqq qq qq q qq q q q q qqq q q q q q q qq q q q q q q q q qq q q q q q q q qq q q qqq q q q qq q qq q q q qqq qqqqq qq q q q q q qqqq q q q q q q qq qq q q qqq q q qq q q q q q qqq qq qq q qq q q qq q q q qq q q q q q q qq q q q qqq q q q q qq q q q q qq q qq q q q qqq qqqqq qq q q q q q qqqq q q q q q qqq qq qq q qq q q q q qqq q q q qq q q q q qq q qq qqq qq q q q q q q q q q qq q q qq q qq q q q qqqq qq q q qq q qq qq qq q q q q q q q qq q q q qq qq qq q q q q qq q qq qq q qqq qq q q q q qqqqq q qqq q q q q q qq qq q q q q q qq q q q q q q q q q q q q qq qq q qq q q q q qq q q qq q qq q q q q q qqq q q q q q q qqqq qq q q qq q qq qq qq q q q q q q q qq qq qq q q q q qq q qq qq q qqq qq q q q q qqqqq q qqq q q q q q qq qq q q q q q qq q q q qq q q qq q q q q q q qq qq q qq q q q q q q qq q qq q q q qqqq qq q q qq q qq qq qq q qq q q qq q q q q qq qq qq q q q q qq q qq qq q qqq qq q q q q qqqqq q qqq q q q q qq qq q q q q q qq q qq q q q q q q q qq q qq qq q q q q q qq q q qq q q qq q q qq qq qqq q q q q q q q q qq q q q q q qq q q qq q q qq qqq q q q q q q q q qq q q q q qq qq q q qq q q q qq qqq q q q q qq q q q q q qq q q q q q q q q qq q q q qq q q q qq q q q q qqqqqq q qqqq q q qq qq q q q qqq q q qq q q q q qq q q q q qqq q q q qq q q q q qqq q q qq qq q q q q q q q q q q q q q q q q q q q q qq q q q qq q q q qq q q q q qqqqqq q qq q q q qq qq q q q qqq q q qq q q q q qq q q q q qqq q q q qq q q q q qqq q q qq q q q qq q qq q q q q q q q q q q q q q q q q q q q q qq q q q qq q q q qq q q q q qqqqqq q qqqq q q qq qq q q q qqq q q qq q q q q qq q q q q qqq q q q qq q q q q qqq q q qq q q q qq q qq q q q q q q q q q q q q q q q q qq q q q q q qq q q q qq q q q qq q q q q q qqq q q q q q q qq q q q q q q q q q q qq qqq q qq q qq q q q q q qq q q q q q qq q q q qq q q q qq q q q q q qqq q q q q q q q q q q q q q q q q q qq qqq q qq q qq q q q q q qq q q q q q qq q q q qq q q q qq q q q q q qqq q q q q q q qq q q q q q q q q q q qq qqq q qq q qq q q q q q q q q q q qq qq qq q q q qq q q qq q q q q q q q q qq q q qq q qqq qq q q q qqqq qq q qq qq qq qq q q q q q qqqqq q qq q qq qq q q q q q q q q q q q q q q q qq qq qq q q q qq q q qq q q q q q q q q qq q q qq q qqq qq q q q qqqq qq q qq qq qq qq q q q q q qqqqq q qq q qq qq q q q q q q q q q q q q q q q qq qq qq q q q qq q q qq q q q q q q q q qq q q qq q qqq qq q q q qqqq qq q qq qq qq qq q q q q q qqqqq q qq q qq q q q q q q q q q q q q q q q qq q q q q q q q q qqq qq q q q q q q q q qq q q q qq qq q qq q q q qqq qqqq q q q q q q qq q q q qq q q q q q q q q qq q q q q q q q q qqq qq q q q q q q q q qq q q q qq qq q qq q q q qqq qqqq q q q q q q qq q q q qq qq q q q q q q qq q q q q q q q q qqq qq q q q q q q q q qq q q q qq qq q qq q qq qqq qqqq q q q q q q qq q q qq q q q q q q qq q q q q q q q qq q q q q q q q qq q q q q q qq q q q q qqq q q q q q q q qq q qq q q q qq q q q q qqq q q q q q q q qq q qq q q q qq q q q q qqq q q q q q q q qq q qq q qq q q q q q q q qq q q q q q q q q q qq q q q q q q q q q qq q q q q q q q qq q q q qq q q q qq q q q q qq q q qq q q q q q qq q q q q q q q qq q q q q q q q q qq q q q qq q q q q qq q q q q qq q q qq q q q q q qq q q q q q q q qq q q q q q q q q qq q q qq q q q q qq q q q q qq q q qq q q q q q qq q q q q q q qq q q q q q q q q q q q q q qq q q q q q qq q q q q qqq q q q qqqq q q qq qq q q q q q q q q q q qq q q q q q qq qq q q q q q q q q q q q q q qq q q q q q qq q q q q qqq q q q qqqq q q qq qq q q q q q q q q q q qq q q q q q qq qq q q q q q q q q q q q q q qq q q q q q qq q q q q qqq q q q qqqq q q qq qq q q q q q q q q q q qq q q q q q qq qq q qq q q q q qq q q q q q qq q q q q q q q q q q q q qq q q q qq qq qq q q q q q qq q q q q q q q q qq q q q q q qq q q q q q q q q q q q q qq q q q qq qq qq q q q q q qq q q q q q q q q qq q q q q q qq q q q q q q q q q q q q qq q q q qq qq q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq qq q q q q q qq q q q q qqq q q q q qq qq q q q q q q q q q q q q q q qq qq q q q q q q q q q q q q q q q q q q q q q qq qq q q q q q qq q q q q qqq q q q q qq qq q q q q q q q q q q q q q q qq qq q q q q q q q q q q q q q q q q q q q q q qq qq q q q q q qq q q q q qqq q q q q qq qq q q q q q q q q q q q q q q qq qq q q q q q q q q q q q q qq q q qq qq q q qq q q q q q q qq q q q q q q qq q q q qq q q q q q q q q q q q q q q q q q qq q q qq qq q qq q q q q q q qq q q q q q q qq q q q qq q q q q q q q q q q q q q q q q q qq q q qq qq q qq q q q q q q qq q q q q q q qq q q q qq q q q q q q q q q q q q q q q q q q q q q qq q q q q q qq q qqq q q q q q q q q q q q q q qq q q q q q qq q qqq q q q q q q q q q q q q q qq q q q q q qq q qq q q q q q q q q q qq q q q q q q q q q q q q qq q q q q qq q q q q q q q q q q q q qq q q q q qq q q q q q q q q q q q q qq q q q q q qq qq q q qq q q q q q q q q qq q q q q q qq q q q q qq q q q q qq qq q q qq q q q q q q q q qq q q q q q qq q q q q qq q q q q qq qq q q qq q q q q q q q q qq q q q q q qq q q q q qq q q q q qq q q q q q q qq q q q q q q q q q qq q q q q q q qq q q q q q q q q q qq q q q q q q qq q q q q q q q q q q qq q q q qq q q q q q q qq q q q qq q qq qq q q q q q q q q q q q q qq q q q qq q q q q q q qq q q q qq q qq qq q q q q q q q q q q q q qq q q qq q q q q q q qq q q q qq q qq qq q q q q q q q q q q q q q q qq q qq qq q q q q q q q q q q q q qq q q q q q q qq q qq qq q q q q q q q q q q q q qq q q q q q q qq q qq qq q q q q q q q q q q q qq q q q qq q qq q q q q q q q q q q q q qq q qq q q q q q q q q q q q q qq q qq q q q q q q q q q q q q q q qq q q q q qq q q q q q q q q q qq q q q qq q q q q q q q q q qq q q qq q q q q q q qq q qq q qq q q q qq q qq q q q q q q q qq q qq q qq q q q qq q qq q q q q q q q q q qq q qq q q q qq q qq q q q q q q q q q qq q q q q q q q qq q q q q q q q qq q q q q q q q qq q q q q q q q qq q q q q q q q q qq q q q q q q q q q q qq q q q qq q q q qq q q q q q q q q q q qq q q q qq q q q qq q q q q q q q q q q qq q q q qq q q q qq q q q q q qq q q q q q q q q q q q q qq q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q qq q q q qq q q q q q q q q q q q q qq q q q qq q q q q q q q q q q q q qq q q q q q q qq q q q q q q q q q q qq qq q q q q q q q q qq qq q q q q q q q qq q q q q q q q q q q qq q q q q q q q q q q qq q q q q q q q q q q q q q q qq q qq q qq q qq q qq q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qqq q q q q q q q q q qq q q q q q q q q q qq q q q qq qq qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q p.adult.college p.under.50k q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q qq q q q q q q q qq qq q q q q q q qq qq q q q q q qq q q q q q qq q q q q qq q qq q qq q qq q q q q q qq qq q q qq q q qq q q q q q q q q qq qq q q qqq q qq q q q q qq q q q qq q q qq q q q qq q q q q q q q q qq q q q q q q q q q q q qq q q q q q q qq q q qq q q q q q q q q q qq q q qq q q q q q q q q q q q qq q q q q q q q q qq q q q q q qq qq q q q q qq qq q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q qq q q q qq q q q q q q q q q q q q q qq q q q q q q q q qq q q q q q q q q q qq q q q q q q q q qq q q q q q qqq qq q q qq q q q q q q qqq qq q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q qq q q q q qq q q q qq q q q q q q q q q q q q q qq q q q q qq q q q q qq q q q qq q q q q q q q q q q q q q qq q q q q q q q qq q q q q q qq q q q q q q q qq q q q qq q q q q q q q q q q q qq q q q qq q q q q q q q q q q q q q q qq q q q q q q q qq q q q qq q qq q q q q q q q q q q q q q q q q q qq q q q q q q q qq q q q qq q qq q q q q q q q q q q q q q qqq qq qq q qq q q q q q q qqq qq qq q qq q q q q q qq q q q q q q q q q qq qq q q q q q q q q q q q q q q qq q q q q q q q q q qq qq q q q q q q q q q q q qq q q q q q q q q q qq qq q q q q q q qq q q qq q q q q qq q q q q q qq q q q q q q q q q qq qq q q q q q q qq q q qq q q q q q q q q q q q q q qq q qq q qq qq q qq qqq qqq q q q q qq q qq q q q q q q q q q q qq q q qq q qq qq q qq qqq qqq q q q q q qq q qq q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qqq q q q qqq q q q q q q qq q q q q qqq q q q q qq qq q q q q q q q q q q q q qq q q q q qqq q q q qqq q q q q q q qq q q q q qqq q q q q qq qq q q q q q q qq qqq q qq q q qq q q q q q qq q qq q q q q qq q q qq q q q q q q q q q q q q q qq qq qq q qq qqq q qq qq q qq q q q q q qq q qq q q q q qq q q qq q q q q q q q q q q q q q qq qq qq q q q q q q q q q qq q q q q q qq q q q q qq q q q qq qq q qq q q q q q q q q q q q q q q q q qq q q q q q qq q q q q qq q q q qq qq q qq q q q q q q q q q qq q q q q q q qq qq q q q qq q q qqq q qq q qqq q qq q q qqq q q qqq q q q qq qq q q q q qq q q q q q qq qq q q q qq q q qqq q qq q qqq q qq q q qqq q q qqq q q q qq qq q q q q q q qq q q q q q qq q q q q qq q qq q qq q qq qq qq q q q qq q qq q q q q q q qq q q q q q q qq q q q q q qq q q q q qq q qq q qq q qq qq qq q q q qq q qq q q q q q q qq q q q q q q qq qq q q q qq q qq q qq q q q qqq q q qq q q qq q qq q q qq q qqqqq q q q qq q q q q q q qq q qq qq qq q q qq q qq q q q q q qq qq q q q qq q qq q qq q q q qqq q q qq q q qq q qq q q qq qqqqq q q q qq q q q q q q qq q qq qq qq q q qq q qq q q q qq q q q q q qq q q q q q qqq qqqqq q q q q q q q qqq q q qq q q q q q q q qq q q q q q qq q q q q q qqq qqq q q qq q q q q q q q qqq q q qq q q q q q q q q q q q q q q q q qq q q q q q qq q q q qq q q q q q q q qq q q q q q q q qqq q qq q q q q q q q qqqq q q q q qq q qq q q q q q q q q q q q q q q qq q q q q q qq q q q qq q q q q q q q qq q q q q q q q qqq q qq q q q q qqqq q q q q qq q qq q q q q qq q q qq qq q q qq q q qq q q q q q q q q q qq q q q q q q qqq q q qq qq q q qq q q q q q q qq q q qq qq q q qq q q qq q q q q q q q q q qq q q q q q q q q qq q q q q q qq q q q q qqqq q q q q q qqqq q q q qq q q q qq q q q q q qq qq q q q q qq q q q qq q q q q qq q qq q q q q qqqq q q q q q qqqq q q q qq q q q qq q q q q q qq qq q q q q qq q q q q qqq q q qq qq q qq q q q q qq q q q q q q q q qq q q q q qq q q qq q qq qqq qqq q qqqq q q qqq qqq q q qq qqq q q q q q q qq q q qqqqq q qqqq q q q q qq q qq q q q q q q q qq q q q q qq q q qq q qq qqq qqq q qqqq q q qqq qqq q q qq qqq q q q q q q qq q q qqqqq q qqqq q q q q q q qq q q q q q q q q qq q qq q q qqq q q q q q q qq qq qq qqq qqqqq qqq q q q qq q q qqqq qq q qq q q q q q qq q q q q q q q q q q q q q qq q qq q q qqq q q q q q q qq qq qq qqq qqqqq qqq q q qq q q qqqq qq q qq q q q q q qq q q q q q qq qq qq q q q q q q qqq q q qqq q qq q q q q q q qq q qq q q q qq q q q qq q q q q qq q q qq qq q q qq qq qq q q q q q q qqq q q qqq q qq q q q q q q q qq q qq q q q qq q q q qq q q q q qq q q qq qq q q q q q q q q qqq q q q q qq qq qqq q q qq qq qq q q q q q q qqqqq qq q q q q q qqq qq q qq qq qqq q q q q q q q q q q qq q q q q q q qq q q q qq q q q q q q q qqq q q q q qq qq qqq q q q qq qq q q q q q q qqqqq qq q q q q q qqq qq q qq qq qqq q q q q q q q q q q qq q q q q q q qq q q q qq q q q q q q qq q qqqqqqqq qq q q qqqq qq qq q qqq q qqqq qq qq qqq q qqq q qqq q q qq qq q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q qq q q q q q q q q q qq q qqqqqqqq qq q q qqqq qq qq q qqq q qqqq qq qq qqq q qqq q qqq q q qq qq q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q qq q q q qq q q qqq q q qq q q qqq q q q q q qq q q q q q q q qq q q q qq q q q q q qq q q q q q q q qqq q q q qq q q q q q q qq q q qqq q q q q q q q q q qq q q q q q q qqq qqq qq q q q q qq qq q q qq q qqq qqq qq qq qq qq q q q q qqq q q q qqq qq qq q q qq qq q q q q q q q qq q q q q q q q q q q q q qq q qq qq q q q qq q q q q q q q q qq q q qqq q q q q q q q q qq q q q q q q qqq qqq qq q q q q qq qq q q qq q qqq qqq qq qq qq qq q q q q qqq q q q qqq qq qq q qq q qq qq q q q q q q q qq q q q q q q q q q q q q qq q qq qq q qq qq q q q q q q q q q q q q q q q q qq q qq qq q q q q q q q q qqq q qq q q q q qqq qqq q q qqqq q qqqq q q q q q q q qq q q qq q q q qq q qq q q q q q q q q q qq q qq qq q q q q q q q q qqq q qq q q q q qqq qqq q q qqqq q qqqq q q q q q q q qq q q qq q q q qq qq q qq q qq q q q q q qq qq q q qq q qq q qqq q q q q q q q qq qqq q qqqq qqq q q q qqq q q q q q qq q q qqq q qq q q q q q q q q q q q q q q q q q q q q q q qqq q q qq qq qq q q q q q q q q q qq q qq q qq q q q q q qq qq q q qq q qq q qqq q q q q q q q qq qqq q qqqq qqq q q q qqq q q q q q qq q q qqq q qq q q q q q q q q q q q q q q q q q q q q q q qqq q q qq qq qq q q q q q q q q q q q q qq q q q q q q q qq q qq q q qq q q q q q q q q qqq q q qqqq q q qqqq qq q q q q q qqq q qqq q qq q qqq qqqqq q q q qqqqq qq qqq q qqq q qqqq q qq qqq q q qq q q q q qq q q q qq q q q q q q q qq q q q q q q q qq q qq q q qq q q q q qqq q q q q q qqq q q qqqq q q qqqq qq q q q q q qqq q qqq q qq q qqq qqqqq q q q qqqqq qq qqq q qqq q qqqq q qq q qq q q q q qq q q q q q q q q q q qq q qq q qq q qq qq q q q q q q q q q qqq qq qqq q q qqq q q q qq qq q qqqqqq qqq qq q qq q qq qq q qq qqqq q q q q qq q qq q qq q q q qq q q q q qq q q qq q qq q q q qq q qq q qq q qq qq q q q q q q q q q qqq qq qqq q q qqq q q q qq qq q qqqqqq qqq qq q qq q qq qq q qq qqqq q q q q qq q qq q qq q q q qq q q q q qq q q qq q qq q q qqq q qq q q q q q q q q q q qq qq q q q q q qq q q qq qq q q q q q q q qq q q q q q q q q q qq q q qq q q q q qqq q qq q q q q q q q q q q qq qq q q q q q qq q q qq qq q q q q q q q qq q q q q q q q q q qq q q q q q q q q q q q qq q q q q q q q q q q q qq q qq q q q q qq q qqqq qqq qq q q qqqq q q q qq q qq q q q q qqq qq q q q q q q q q q qqq q q qqq q qqqqq qqq qqq q qqqq qq q q q qqqqq q q qq qq q qqqqqqqq q qqq q qq qq q q q q q q q q q qqq q q qqq q q q q q q q q qq q q q q qq q q q q q q qq q q q q q q q q q q q qq q qq q q q q qq q qqqq qqq qq q q qqqq q q q qq q qq q q q q qqq qq q q q q q q q q q q qqq q q qqq q qqqqq qqq qqq q qqqq qq q q q qqqqq q q qq qq q qqqqqqqq q qqq q qq qq q q q q q q q q q qqq q q qqq q q q q q q q q qq q q q q qq q q q q q q qq q q q q q qq q qq q qqq qq q q qqq q q q qq qqq q q qqq q q q qq qq qqqq q qq q q qq qq q q qq q q qqq q q q qq q q q qq qq q q q q q q q q q qq q qq q qqq qq q q qqq q q q qq qqq q q qqq q q q qq qq qqqq q qq q q qq qq q q qq q q qqq q q q qqq q q qq qq q q q qq q q qq q q q q q qq q qq qq q q q q q q q q qq qq q q q q q q qqq q qqq qq q qqqqqqqqqqqqqqq qqqqq qq qq q q qqq q q qq qqqqq q qq q q qq q qq qq q q q q qq qq q q q q q qq qq q q qqq qq qq q q qq q qqq q q q q q qqq qq qq q q q q q q q qq qq q q q q q q qqq q qqq qq q qqqqqqqqqqqqqqq qqqqq qq qq q q qqq q q qq qqqqq q qq q q qq q qq qq q q q q qq qq q q q q qq qq q q qqq qq q qq q q q qq qq qq qq q qq q q q q q qq qqqq q q qq q q qq q qqqqqq q q q q q q q q q qq q qq q qq q q q q q qq q qq q qq qq q q q q qq q q qq q q q qq qq qq qq q qq q q q q q qq qqqq q q qq q q qq q qqqqqq q q q q q q q q q q q qqq q q q q qqq qq q q qq q qq q q q q qq q qq q qq qq q q q q qq q q q qq q q q q q q q q q q q qqq qq q q q q q q q qqq qqqqq q q qqqq qqqq qqqq qqqq qqq qq qq q q qqqq q q q qq qq q q q qq q q q qq q qq q q q q qq q q qqqqq q q qqqq qq q q qq q q qq q q q q q qq q q q q q q q q q q qq q q q qq q q q q q q q q qqq qqqqq q q qqqq qqqq qqqq qqqq qqq qq qq q q qqqq q q qqq q q q qq q q q q q qq q qqq q q q q q q qqq q q q qqq qq qq q q qq q q qq q q qq q qq q q q q qq q qqq q q q qq q q q qq qq qq q q q q qq q qqq qq q q q q q qq q q qq qq q qqq q q q q q qq q q q q q q q qq q q qq q q q q qqqq qq q qq q qq q q qqqqqq q q qqqqq q qqqq qqqq q q qqqqqq qqqqq q q q q q q qq q q q q qqq q q q q q qq q qq q q q q qq q q qqq q qq q qq q qq qq q q q q q qq q q qqqq q q q q q q q q q q q q qq q q q q q q qqqq qq qqqqq qq q q qqq qqq q q qqqqqq qqqq qqqq q q qqqqqq qqqq q q q qqq q qqqq qqqq qq qqq q q q q q q q q qqq q q q q q q qqq q q q q qq q q q q q q q q qqq qqq q q q q q q qqq qqq qq q q qqq q q q q q q q q qq qqq qq q q q qq q q qq q qq q q q qq q q qq q qq q q q q q qq q q q qq qq q q qqqq qq qqqqqqq q q q qqq q qq qqqqq qq qq qq q q qq qq qq q q q q q q q q q q qq q q qq q q qqq q qqq qqq qqq q qq q qq q q qq q qqqqqq q q qq q qq qqqq q qqqqq qq qq qqqqq qq q q q qqq qq qq qq qqqqq q q qq q q q q q q q qq qq q q q q q q q qqqqqq q qq q q q q qq qqq qq q qqqq q q q qq q q q q q qq qq q q q qq qq q q q q q q q q q q q q q qq q q q q qq q q q q q qq qq q q q q qq q q q q q q q q q q q qq qq qq q q q q q q q q qq q q q q qq q q q qqqq q q q q q q q q q q q q q qqqq q qqqqq q q q qqqqq q qq q q q q q q q qqqqq q q q qqq q q q qq q qqq q qqq qq q q q qqq q qq qq q q qq qq qq q q q q q q q q qq q q q q q q q q q q q q q q q qq qqq q q q qqq q q q q q qq qq q qq q q q qqq qq q q qqq q q q q q qq q qq q q qqq qq qqqq q qqqqq q q qq qqqqqqq q q q q q q q q q qqqq q q qq qqqq q qq q qq q q q q q qqq qq q q q q q q qq qq qq q q q q qq q qq qq q q q q q q q q q q qq qq q q q q q q q qq qqq qq q qqqqqqq qqqqqq qqqq qqq qqqqqq qq q qq qq qqq q q qq q q qq q q q q q q qq q q q q qqq qq qqq q q q q q q q q q qq q q q q q qq q q q qq q q q q qqq qq q qqq qq qqq q q qq q q q q q q q q q qq q qq q q q q q q qq q q q q qq q q qq q q q q q q q q q q q q q q q q q qq qq q q q q q q q qq qqq qq q qqqqqqq qqqqqq qqqq qqq qq qqqq qq q qq qq qqq q qq q q qq q q q q qq q q q q qqq qq qqq q q q q qq q qq q q q qq q q q q qqq qq q qqq qq qqq q q q qq q q q q q q q q qq q qq q q q q q qq q q q q q qq q q q qq q q q q q q q q q q qq qq q q q q q q qqq q qqq q q q q q q qq q q q qq q q q q qq q q q qqq qq q qq qqq q qq qqq q qqqqqq qq qqqqq qq q qqqq q q qqq q q qq q q q q qqqq q qqq q qqq q q qq qq q q q q qq qq q q q q q qq q qq qq qq q q q q q q q q q qq q q q q q q q q q q q qqq q q q qq qq q q q q q qq qq q q q q q q qqq q qqq q q q q q q qq q q q q q qq q q q q qq q q q qqq qq q qq qqq q qq qqq q qqqqqq qq qqqqq qq q qqq q q q qqq q q qq q q q q qqqq q qqq q qqq q q qq qq q q q q qq qq q q q q q qq q qq qq qq q q q q q q q q q qq q q q q q q q q q q q q qqq q q q q q qq q q q q qq qq q qq q q q qq q q q q q q q q q q q q q qq qq qq qq qq q qq qqqqqq q q qq qq q q qq q qqq q q q q q q qq qq q q q q q q q q qq qq q qq q q q qq q q q q q q q q q q q q q qq qq qq qq qq q qq qqqqqq q q qq qqq q qqq q qqq q q q q q q qq qq q q q q q q q qq q q q q q q qq q q q q qqq qq q q q q q q q qq q q q q q qq q q q q q q qqqq q q qq qqqqqq qqqq qq qqqq q qqqqqqqq qqq q q q q q q q qqq q q qqq q qq qqq qq q q q q q q q q q q qq q q q qq q q q q q q q q q qq q q q q q q q qq q qq q qq q q q q q q qq q q q q qqq qq q q q q q q q qq q q q q q qq q q q q q q qqqq q q qq qqqqq q qqqq qq qqqq q qqqqqqqq qqq q q q q q q q qqq q q qqq q qq qqq qq q q q q q q q q q q qq q q q qq q q q q q q q q q qq q q q q q q q qq q qq q qq q q q qq q qq q qq qq q qq qq q q q qqq q q q qqq qqq qqqq qqq qq qq q qq q qqqq q qq q q qqq qq q q q q q q qq q q q qq q q q qqq qq qqqqq qq q q q q qq q q q q q q q q q q qq q q qq q q q q qq q q qq q qq q qq qq q qq qq q q q qqq q q q qqq qqq qqqq qqq qq qq q qq q qqqq q qq q q qqq qq q q q q q q qq q q q qq q q q qqq qq qqqqq qq q q q q qq q q q q q q q q q q qq q q qq q q q q q qq q q q q qq q q qq q q q q qq q q q q q q q qq qq q q q q q qq qq q q qqq q qq q q q q qqqqqq q q qq qqq qq qqq q q qq q qq q q q qq qqq q q q q qq q qqq q q q qq q qqq q q q q q qq q q qqqqq q qq qqqq q qq qqq qqq qqqqq q qqqqqqqq q qq qqqqqq q q q qq q q qq qq q qq q q qq qqq q qq q q q qq q q qq q qq q q q qq q q q q q qq q q qq q q q q qq q q q q q q q qq qq q q qqq q qq q q q q qqqqqq q q qq qqq qq qqq q q qq q q q q q qq q q q qq q q q qq qqq q q q q qq q qqq q q q qq q qqq q q q q q qq q q qqqqq q qq qqqq q qq qqq qqq qqqqq q qqqqqqqq q qq qqqqqq q q q qq q q qq qq q qq q q qq qqq q q q q q q qq q q qq q qq q q q qq q q qq q q q q q q q q q qq q q qq q q q qq q qqqqqq q qq q q q q q q q qq qq q qq q q qqqq q qq q qqq qqqqq qqq q qq qq q qq q q q q q qq qq q q q qqqq qqqq q q q q q q q q q q q qq q q q qq q q qq q q q q q q q q q qq q q qq q q q qq q qqqqqq q qq q q q q qq qq q qq q q qqqq q qq q qqq qqqqq qqq q qq qq q qq q q q q q qq qq q q q qqqq qqqq q q q q q q q q qq q q q q qq q qq q q q qq q qq q q q q q q q q q q qq q qq qq q qq qq q qqqq qqqqq qq qq qq qqqqqq qqqqq q qq qq qq q qqqqq qqq qq q qq qqqq q q q qqq q qq q q q q q q q q q qq qq qq q qqq q q q q q q q q qq q q q q q qq q qq qq q q q q q q q q q q qq q q q qq q q q qq q q qq q q q q q q q q q qq q qq q q q qq qq q qqqq qqqqq qq qq qq qqqqqq qqqqq q qq qq qq q qqqqq qqq q q q qq qqqq q q q qqq q qq q q q q q q q q q qq qq qq q qqq q q q q q qq q q q q q qq q q q q q qq q qq qq q q q q q q q q q q q qq q q q q q q q qqq q q q q q qq q q q qqq q q q q qqqq qqqqqqqqqq qqqqqqqqqqqqqqqqq qqqqqqqqqqq qqqqq q qqq q q qqqq qq qq q qq q q qq q qq q q qq q qq q qq q qq q q q q q qq qq q q q q q q qq q q qqq q q q q q qq q q q qqq q q q q qqqq qqqqqqqqqq qqqqqqqqqqqqqqqqq qqqqqqqqqqq qqqqqqqqqq q q qqqq qq qq q qq q q qq q qq q q qq q qq q qq q qq q q q q qq q q q q q q q q q q q qq q q q q q q q q q q q q q qq qq q q q q q q q q qq qq qqq q q qqqqqqqqqqqqq q qq qqqq qqq q q q q qqq qq q qq q q q qq qq qq q qq q q q q q q q q q q q q qqq q q q qq qq qq q q q q q q q qq q qqqqq q q qqq q q q q q q qqq q q qq q q q q q q q qq q q q q qq q q q q q q q q q qq q q q q q q q q q q q q q qq qq q q q q q q q q qq qq q qq q q qqqqqqqqqqqqq q qq qqqq qqq q q q q qqq q q q q q q q qq qq qq q qq q q q q q q q q q q q q qqq q q q qq q qq q q q q q q q qq q qqqqq q q qqq q q q q q q qqq q q q q q q q q q q qq q q q q q qq qq q q q q q q q q q q qqq qq q q q q q q q q q qq q q q q q q qq q q q q q q qq q q q qq qq q q q q qqq q qqq q qqq q q q q qq qq qq q qq qqq qqq q qq q q q qqq qq qq qqq q qq q q q qq q qq q q q q q qq q q q qq q q qqq q qq qq q q q q q q q q q q qqq qq q q q q q q q q q qq q q q q q q qq q q q q q q qq q q qq qq q q q q qqq q qqq q qqq q q q q qq qq qq q qq qqq qqq q qq q q qqq qq qq qqq q qq q q q qq q qq q q q q q q qq q q q qq q q qq q q q q qq q q q q q q q q q q qq q q q q q q q q q q q qq q q qqqq qqqq qq qqqq q qqqqqqqq qqqq q qqq qqq q q qq q q q qq q qq q q q qq q qq q q qq q q q q q q q q q q q q q qq qqqqqqqqq qqq qqqqqqqqqqqqqqqqqqqqqqq q qqqq q qq qqq q qqq q q qq q qq qq q q qq q q qqqqqq qq q q q q qq qq q q q q q qq q q q qq qq q q qq q qq q q q q qq q q q q q q q q q q qq q q q q q q q q q q q qq q q qqqq qqqq qq qqqq q qqqqqqqq qqqq q qqqqq q q q qq q q q qq q qq q q q qq q q qq q q q q q q q q qq q q qq qqqqqqqqq qqq qqqqqqqqqqqqqqqqqqqqqqq qqq q q q qq qqq q qqq q q qq q qq qq q q qq q q qqqqqq q q q q q q qq qq q q q q qq q q q q q q qq q q q qq q qq q q qq q qq q qq q q qq qq qqq q q qqq q q q q q q q q qq q q qq qqq qqq qqq qq q qqqq q qq qq q q qqqq q q qqq q q qqqqqqqq q qqqqq q q q q q q qq q q q qqq q qq q qq q q q q q q q q q qq qq qqqqqqqqq qqq qq q qq qqq qq q qqq q q q q qq qq q q qq qq q qq q q q q q qq q q q q qq qq q q qqq q q q qq q q qq qq qq q q qq qq qqq q q qqq q q q q q q q q qq q q qq qqq qqq qqq qq q qqqq q qq qq q q qqqq q q qqq q q qqqqqqqq q qqqqq q q q q q q q q q qq qqq qq q q q qqqq q qq q qq q q q q q q q q q qq qq qqqqqqqqq qqq qq q qq qqq qq q qqq q q qq qq q q qq qq q q q q qq qq qq q qqq q q q qq q q qq qq qqq q q q q q q q q q q q q q q q q q q q qq q q q qq q q q q q q q q q q q qqq q qq qq q qqq qq qq qqqqq qqqq qq q qqqqqqqqq qqq q qqqqqqqqqqq q qqqqqqq qqq qq q q q qq q q q qqq q qqq q q q qq q q q qq qqq q q q q q q q q q q q q q q q q q q q qq q q q qq q q q q q q q q q q q qqq q qq qq q qqq qq qq qqqqq qqqq qq q qqqqqqqqq qqq q qqqqqqqqqqq q qqqqqqq qqq qq q q q qq q q q qqq q qqq q q q qq q q q qq q q q q q qqq q qq q q q q q q qq qqq qq q qq q qq q q q q q q q q q q qqq qq q q q qqqq qq qq q q q qq qqqqqq qqq q qqqq q q qqqq q q q q q q q qq q q q q q qq q q q q q q q qqq q q qqq q q qq q qq qq qq q qqqqq q qqqq qqqqqq qqqqqq qqqqq qqq qqqqq qq qqqq qqqqqq qqq q q q qq q q qq qq q q q q qq q q q qq q q q q q q qqq q qq q q q q q q qq qqq qq q qq q qq q q q q q q q q q q qqq qq q q q qqqq qq qq q q q qq qqqqqq qqq q qqqq q q qqqq q q q q q q q qq q q q q q qq q q q q q q q qqq q q qqq q q qq q qq qq qq q qqqqq q qqqq qqqq q qqqqqq qqqqq qqq qqqqq qq qqqq qqqqqq qqq q q q qq q q qq qq q q qq qq q q q qq q q q q qq q q q q q q qq q q qqq qq q q q q q q q q q qqq q q qqq q qq qqq qq q q q qq q qq q q qq q q qq q qq q q q q q qq qqq qqqqqqq q qqqq q qqqqq qqqqqq qq qqqqqqqqqq qqqq q qqq q q qq qqqq qq q q q qq q q qq qq q qq q qq q q q q q qqq qqq q q q qq qq q q qqq q q q q q q qq q q qqq qq qq q q qq q q q q q qq q q q q q q qq q q qqq qq q q q q q q q q q qqq q q qqq q qq qqq qqqq q q qq q qq q q qq q q qq q qq q q q q q qq qqq qqqqqqq q qqqq q qqqqq qqq qq qq qqqqqqqqqq qqqq q qqq q q qq qqqq qq q q q qq q q qq qq q qq q qq q q q q q qqq qqq q q q qq qq q q q qq q q qqq qq qq q q qq q q q q q q qq q q q q q qq q q q q q q q qq q qq q q qqqq qq qq q q q q qqq q q q q q q q qq q q q q qqqqq qqq q qq qqqqqq qqqqqqqqqq qqqqq qq q q qq qqqqq q q qqq q q qqq q qqqq q qq q q q q q qqq q q qq q q qq qqq qq qqqqq qq q qq q q qq q qq q q qq q q q q q qq q q q q q q q qq q qq q q q q qqq q q q q qqqq qq q q q q q qqq q q q q q q q qq q q q q qqqqq qqq q qq qqqqqq qqqqqqqqqqqqqqq qq q q qq qqqqq q q qqq q q qqq q qqqq q qq q q qqq q q qq q q qq qqq qq qqqqq qq q qq q q qq q qq q q q q q q q q q q q q q qq q q q qq q q q qq qqq q q q q q q q q qqq q q qqq q qqqqqqqq q qq qq qq qqqq qq qq q q q qq qq q qqq q qqq q q qq q q q q qq q q q qq q q q q q q q q qq qq q qq q qq qq q q q q q q q q q qq q q q qq q q q qq qqq q q q q q q q qq q qqq q q qqq q qqqqqqqq q qq qq qq qqqq qq qq q q q qq qq q qqq q qqq q q qq q q q q qq q q q qq q q q q q q q q qq q qq qq q q q qq q qq qq q q q qq q qq q q q qq q q q qq q q q q q q q qqqq qq q qq qqq qqqqq qqqqq qqqqq qqqqqqq qqqq qqqq qq q qqqqqq qqq q q q qq q q q qq q q qq q q q q qqq q q q q q q q q q q qq q q qq qq qq q q q qqq q q q q q q q q q qq q qq qqqq q q qq qqq q q q q q qq q q q qq qq q qq q q q qq q q q qqq q q qq q q qq q qq q q q qq q q q qq q q q q q q q qqqq qq q qq qqq qqqqq qqqqq qqqqq qqqqqqq qqqq qqqq qq q qqqqqq qqq q q q qq q q q qq q q qq q q q q qqq q q q q q q q q q q qq q q qq qq qq q q q qqq q q q q q q q q q qq q qq qqqq q q qq qqq q q q q q qq q q q qq qq q qq q q q qq q q q qqq q q qq q qq q q q q qq qqqq q qqq q q q q q qq q q q q qq q q qq q qq q q q qq qqqqq q qqq qq q qq qqq q q q q q qqq q q q qq qq q q q q q q q qq q q qq q qqq q qqq qqqqqqqqqqqqqq qqqq qq qqqqqq q qqq qqqqqqq q qqqq qqqq qq q q q q qq q q q q q q q q q qq qq q q qq q q q qq q q qq q q q q qq qqqq q qqq q q q q q qq q q q q qq q q qq q qq q q q qq qqqqq q qqq qq q qq qqq q q q q q qq q q q qq qq q q q q q q q qq q q qq q qqq q qqq qqqqqqqqqqqqqq qqqq qq qqqqqq q qqq qqqqqqq q qqqq qqqq qq q q q q qq q q q q q q q q q qq qq q q qq q q q qq q qq q q q q q q q q q q q q q qqq q q qq q qqq qqq q qq qq q qq qq q q q qq q qq q qq q q q q qq q qq q q q q q qq qqq q q qqqq qq qqqq qq qqqq qqqqqqqq qq q qq qq q q q q q qq q q q q q q q q q q q q q q qq q q q q q qq q q q q q q q q q q q q qqqq q q qq q qqq qqq q qq qq qqqq q qq q q q qq q qq q qq q q q q q qq q q q qq qq q q q q qq qqq q q qqqq qq qqqq qq qqqq q qqq qqq qq q qq qq q q q q q qq q q q q q q q q q qq q q q q q q qq q q q q qqq qqq qqqqqqq q qq qqqqq qqqqqqqqqq qqq qqq qqqq qqqqqqqq qqq q q qq q qqq q qqqq qq q qq q qqq q q q q q q q q qq qq qqqq qq q q q q q q qq qq q q q q qqq qqq qqqqqqq q qq qqqqq qqqqqqqqqq qqq qqq qqqq qqqqqqqq qqq q q qq q qqq q qqqq qq q qq q qqq q q q q q q qq q q q q q qq qq qq q q qq q q q qq q q qq q qq q qq q q qq qq q q q qqq q q q q q qq q q q q q q qq q qq q q qq qq q q qq q q q q q qq q q q q q qq qq q q q q qq q q q qq q q qq q qq q q q q q qq qq qqqq qq q q q q q q qq q qq q q q q qq qq q q q q q q qq qq q qq q qq q q q q q q qq q q q q qqq q q q q qq q q q q q q qq q q q q q q q q qq qq q qq q q q qqq q q q q q qq qq qq q qq q q qq q q q qq q q q q qq q q qqqqqqq qq qqq q q q q q q q q q qqq q qqqqqq q qqqq qqqqqqqqqqq q qq qqqq q q q qq q q q qq qqq qqqqq qq q qqq qq q qqqqqqqqq qq qq q qq qq qqqq q qqq qq qq q q q q q q qq qq qq q q q q q q q q q q q q qq q q qq qqq q q qq qq q q q q q q q q qq qq q qq q q q qqq q q q q q qq qq qq q qq q q qq q q q q qq qqq qqqqq qq q qqq qq q qqqqqqqqq qq qq q qq qq qqqq q qqq qq qq q q q q q qq q q qqqqqqq qq qqq q q q q q q q q q qqq q qqqq q q qqqq qqqqqqqqqqq q qq qqqq q q q q q q q q q qq q q q q q q q q qq q q q qq q q qq qqq q q qq qq qq q q qqq q q q qq q q q q q q q q qq q q q qqq q q q q q qq qq q q q qq q q q q q q qq q q q q q q qqqq q q qq q q q q qq qq q q q qqq q qqqq qqqqqqqq qqqqqq qqqqqq q q q qq q q q qq q qqq qq q q qq q qqq q q q qq q q q q q q q q qq q q q qqq q q q q q q qq q q q q q q qqqq qq qq q q q q qq qq q qq q q q qqq q qqqq q qq qq qqq qqqqqq qqqqqq q q q qq q q q qq qqq qqq qq q q qq q q q qq qq qq q q q qqqq q q q qq q qq qq qq qq q q q q q q q qq q q q q qqq qqqqqqq qqq q q qq qqq qqqqq q qqq qqqqqq qqq qq q qq q q qq q q qq q q q q q qq q q q qq q q qq qq qq q q q qqqq q q q qq q qq qq qq qq q q q q qq q qqq q qq q q q q qqq qqqqqqq qqq q q qq qqq qqqqqq qqq qqqqqq qqq qq q qq q q qq q q qq q q q q q q qq q q q q q q qq q qq q q q qq qq q q q q q q q q q q qq q qq qq q q q q q q q q qq q q qqq q q q qqqqq q q q qq qqq q qq qq q q q q q q q q q q qq q q q qq qq q q q q q q q q q q qq q qq qq q q q q q q q qqq q q q qqqqq q q q qq qqq q qq qq q q q q q q q q q q q qq q q q q qqq qq q q q q qq q q q q q q q qq q q q qq q q qq q qq q q qqq q qq qqq q qq qq q qq q qq q q q q q q q q q q q q q q q q q q qq q q qq q q q q qqq qqqqqqq qqqqqq qqqqq qqqq q q qqq qqq q q q q qq q qq q qq q qq q q q q q q qqq q qq q qq q qqqq q qqq qq q qq q qq q qq q q q q q q q q q q q q qq qq q q q q qqq qq q q q q qq q q q q q q q qq q q q qq q q qq q qq q q qqq q qq qqq q qq qq q qq q qq q q q q q q q q q q q q q q q q q qq q q qq q q q q qqq qqqqqqq qqqqqq qqqqq qqqq q q qqq qqq q q q q qq q qq q qq q qq q q q q q q qqq q qq q qq q qqqq q qqq qq q qq q qq q qq q q q qq q q q q q q q qq qq q qq q q q qq q q q q q q q q q q qqqq q q q q qq q q q q qq qq q q q q q qqq q q q qq qqqq qq q q q q q q q q qq q q q q q q q q q q qqqq q q qqq q qqqqqqq qqqqqq q qqqq q q q q qq q qqq q q q qqq q q qq q q qq qq q q qq q qqq q q q q q qq qq q q qq q q q qq q q q q q q q q q qqqq q q q qq q q q q qq qq q q q q q q q q q q qq qqqq qq q q q q q q q qq qq q q q q q q q q q qqqq q q qqq q qqqqqqq qqqqqq q qqqq q q q q qq q qqq q q q qqq q q qq q q qq q qq q q qq q qqq q q q qq q qq q q q q q q q qq q qq qq qq q q q q q qq q q q qq qq q q q q q q qq q qqqqq qq q qq q qqqqq q qqqqq q q q q q q q q q q q q q q q q q q q q q q qq q qq qq qq q q q qq qq q q q q q q qqqqq qq q qq q qqqqq q qqqqq q q q q q q q q q q qq q q q q q q qq qq q q q q q q q q qqq q q q qq q qq q q qq q qq q q q q q q qq q q q q q qq q qqq q qqq qq q q q q q q q q q qq q qq qq q qqqqqq q q qq qq q qqqq qqqq qqq qqqq q qq qq qqqq q q qqq q qq qq q q q qqq qq q q qq q q q q q qq q q q q qq q q q qq q q qq q q qq q q q qqq q q q qq q qq q q qq q qq q q q q q qq q q q q q qq q qqq q qqq qq q q q q q q q q q qq q qq qq q qqqqqq q q qq qq q qqqq qqqq qqq qqqq q qq qq qqqq q q qqq q qq qq q q q qqq qq q q qq q q q q q qq q q q q qq q q q qq q q qq q q qq q q q q q q qq q q qq qq q q q q q q qq q q q q q q qq q q q qq qq q q qq qq q qq q qq qq q qq q q qq q q q q qq q q qq q q q q q q q q q q qqq q q q q qq q qq qq q q q q qq q q q q qq qq q q qq qq qq qq q qq q q q qq q q q q q q qq q q qq qq q q q q q q qq q q q q q q q qq q q q qq qq q q qq qq q qq q qq qq q qq q q qq q q q q qq q q qq q q q q q q q q q q qqq q q q q qq q qq qq q q q q qq q q q q qq qq q q qq qq qq q q q qq q q q qq q q q qq q q q q q q qq qqq q q qq qq qq q qq q q qq q q q qqqqqqqq qqq q qq q q qq q qq q qq qq qqqqq qq q q q q q qq qq q q q q q q q q q q q q q qqq q q qq q qq q q q q q q qq q q q q q q qq qq q qq qq qq q qq q q qq q q q qqqqqqqq qqq q qq q q qq q qq q qq qq qqqqq qq q q q q q qq q q q q q q q q q q q q q qqq q q qq q qq q q q q q q q q q q qq q q q q qq q q qq q q q q q qqq qqqqq qq q q q q q qqqq q q q q q q qq qq qq q q q q qq q q q q q q q q q q q q q q q q qq q q q q q q q q qq q q qq q q q q q qqq qqqqq qq q q q q q qqqq q q q q q q qq qq qq q q q q qq q q q q q q q q q q qq q qqqq q q q qq q qq q q qq q q qq q q qq q q q q q q qq q q q qq q q q q q q q qq q qqqq q q q qq q qq q q qq q q qq q q qq q q q q q q qq q q q qq q q q q q q q q qq q qq q q qq qq qq qq q qqqq q q q qq q q qqq qqqqq qqq qq q q qq q qq q qqqqq qq q q q q q qqqq qq q q q qqqqqq q q q q q q q qqq qq q q q q q q q q qq q qq q qq qqqqq qq q q qq qqq q q q qq qq qq q q q q qq q qq q q qq qq qq qq q qqqq q q q qq q q qqq qqqqq qqq qq q q qq q qq q qqqqq qq q q q q q qqqq qq q q q qqqqqq q q q q q q q qqq qq q q q q q q q q qq q qq q qq qqqqq qq q q qq qqq q q q q q qq qq q q q q q qq q q q qq q q qq qqq q q qq q qq q qq q q q qq q q q q q q q q q q qq q q q qq q q qq qqq q q qq q qq q qq q q q qq q q q q q q q q q q q q q qq q q q q q qq qq q qq qq q qq q q q qqqqqq qq q q qq qq q q qq qqq q q q q q q q qqq qq qq q qqq qq qq q q q q q q q q qqq q q q q q q q q q q qq qq q qq q q q q q q q q q q q q q q q qq q q q q q qq qq q qq qq q qq q q q qqqqqq qq q q qq qq q q qq qqq q q q q q q q qqq qq qq q qqq qq qq q q q q q q q q qqq q q q q q q q q q q qq qq q qq qq q q q q q q q q q q q q q q q q q q qqq qq q q q q q qq q qq qq qqq q q q q q q q q q q q q q qqq qq q q q q q qq q qq qq qqq q q qq q q q q q q q qq q q q q q q q q q q q q q q q q qq q qqqq q q q q q q q q q q q q q q qq q qqqq q q q q q q q q qq qq q q qq q q q q q qq q q q qq q qq q qq qq qq q qq q q q q q qqqqq qq q qq qq qq qq q q q q q qq qq q q qq q q q q q qq q q q qq q qq q qq qq qq q qq q q q q q qqqqq qq q qq qq qq qq q q q q q q q q qq q q q q q q q qq q q qq q q q q q q q qqq q qq q qq q q q qq q q qq q q qq q q qq qq q q q q q q qq q q q q q q q qq q q qq q q q q q q q qqq q qq q qq q qq q qq q q qq q q qq q q qq qq q q q q q qq q q q q q q q q q q qqq q qq q q q q qq q q qq qqqq q q qq qqq q q q q q q q q q q qq q q qq q q q q q q q q q q qq q qq q q q q qq q q q q q q q q q q qq q qq q q q q qq q q qq qqqq q q q q q q q q q q q q q q q qq q q qq q q q q q q q q q q qq q qq q q q q q q q q q q q q q qq q q q q q q q q qq q q q q qq q q qq q q q q q q q q q q q q q q q qq q q qq q q q q q q qq q q q q qq q q qq q q q q q q qqq q q q q qq q q q q q q q qq q q qq q q q q qqq q q q qqqq q q qq qq q q q q q q q q q q qq q q q q q q qq q q q qqq q q q q qq q q q q q q q qq q q qq q q q q qqq q q q qqqq q q qq qq q q q q q q q q q q qq q q q q qq qq q q q q q q q q q q q q q q q q q q q qq q q q q q qq q q q qq qq q q q q q q qq q q q q q q qq q q q q q qq q q q qq qq q q q q q q qq q q q q q q q q q q q q q q q qq qq q q q q q q q qq q q q q qqq q q q q qq qq q q q q q q q q qq q q q q qq qq q q q q q q q q q q q q q q q q q q q q q qq qq q q q q q q q qq q q q q qqq q q q q qq qq q q q q q q q q qq q q q q qq qq q q q q q q q q q q q q qq q q qqqq q q qq q q q q q q qq q q q q q q qq q q q qq q q q q q q q q q q q q q q q q q qq q q qqqq q qq q q q q q q qq q q q q q q qq q q q qq q q q q q q q q q q q q q q q q q q q q q qq q q q q q qq q qq q q q q q q q q q q q q q q qq q q q q q qq q qq q q q q q q q q q qq q q q q q q q q q q q q qq q q q q qq q q q q q q q q q q q q qq q q q q q qq qq q q qq q q q q q q q q qq q q q q q qq q q q q qq q q q q qq qq q q qq q q q q q q q q qq q q q q q qq q q q q qq q q q q qq q q q q q q qq q q q q q q q q q qq q q q q q q qq q q q q q q q q q q qq q q q qq q q q q q q q qq q q q q qq qq q q q q q qq q q q q q q qq q q q qq q q q q q q q qq q q q q qq qq q q q q q qq q q q q q q q qq q q q q q q qq q q qq qq q q q q q q q q q q q q q qq q q q q qq q q q q q q qq q q qq qq q q q q q q q q q q q q q qq q q q q q q q q q q q q q qq q q qq q qq q q q q q q q q q q q q qq q q q q q qq q q q q q q q q q qq q qq q qq q q q qq q qq q q q q q q q qq q qq q qq q q q qq q qq q q q q q q q q q qq q q q q q q q qq q q q q q q q qq q q q q q q q qq q q q q q q q q q q qq q q q qq q q q qq q q q q q q q q q q qq q q q qq q q q qq q q q q q q qq q q q q q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q q q qq q q q qq q q q q q q q q q q q q qq q q q q q q qq qq q q q q q q q q qq qq q q q q q q q qq q q qq q q q q q q qq q q qq q q q q q q q qq q qq q qq q qq q q q q q q q q q q q q qq q q q q q qq q q q q q q q q q q q q q q q q q qqq q q q q q q q q qqq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q ak Ho man ho man@ ahoo n om L a n ng om W b A SM 2011 08 01 18 / 42
- 26. Site-level skew p.white apps.myspace.com activities.myspace.com webim.myspace.com friends.myspace.com webfetti.com profileedit.myspace.com signups.myspace.com messaging.myspace.com eq.rockyou.com photoupload.myspace.com searchservice.myspace.com browseusers.myspace.com comment.myspace.com home.myspace.com secure.myspace.com viewmorepics.myspace.com streamate.com myspace.commusic.myspace.com collect.myspace.com eltpath.com playsushi.com profile.myspace.com vids.myspace.com toolbar.inbox.com zwinky.com blogs.myspace.com photobucket.com fling.com nick.com snagajob.com youtube.com bulletins.myspace.com tagged.com gamevance.com gamehouse.com mtv.com mywebtattoo.com edit.yahoo.com adserve.brandgivewaycentre.com cim.meebo.com messenger.yahoo.com t−mobile.com fafsa.ed.gov app2.yoville.com answers.yahoo.com us.peeplo.com search.mywebsearch.com windowsmedia.com metrolyrics.com toolbar.yahoo.com degrees.classesusa.com bigfishgames.com music.yahoo.com kmart.com profile.live.com blurtit.com kaboodle.com gamestop.com fastbrowsersearch.com search.conduit.com youmindquizzes.com courseadvisor.com eversave.com iqquizapp.com findstuff.com try.alot.com winster.com discounts.shopathome.com profiles.yahoo.com onlineprofitsnow.com msg.yahoo.com webcrawler.com officialiqquiz.com scribd.com ask.com rds.yahoo.com walmart.com pogo.com help.yahoo.com translate.google.com chacha.com real.com media.causes.com home.live.com iwon.com yellowpages.com squidoo.com login.facebook.com shine.yahoo.com game3.pogo.com coolsavings.com familylink.com gamespot.com pornhub.com local.com myfuncards.com qualityhealth.com worldwinner.com lifescript.com instoresnow.walmart.com shop.avon.com addictinggames.com autos.yahoo.com answerbag.com account.live.comchannel.facebook.com wiki.answers.com lgn5.coolsavings.com help.live.com hrblock.com upload.facebook.com register.facebook.comrighthealth.com cbk1.google.com twitter.com lgn3.coolsavings.com answers.com creditreport.com video.yahoo.com oprah.com images.google.com hubpages.com tv.com buzzle.com games.com omg.yahoo.com drugs.com music.aol.com ww23.rr.com pharmdaily.com pronto.com angelfire.com pizzahut.com login.yahoo.com sprint.com video.google.com mozilla.com dictionary.reference.com zimbio.com shell.windows.com everything.yahoo.com best−price.com nlm.nih.gov us.mcafee.com smarter.com disney.go.com tvguide.com api.facebook.com livejasmin.com business.com systemofdeals.com search.yahoo.com get.adobe.com facebook.com localization.att.com turbotax.intuit.com www1.macys.com redtube.com java.com games.yahoo.com insureme.com apps.facebook.com www4.jcpenney.com true.com hulu.com geocities.com paypal−shopping.com local.yahoo.com urbandictionary.com hotjobs.yahoo.comtopix.com intelius.com wireless.att.com rightathome.com www3.jcpenney.com bettycrocker.com avg.com connect.facebook.com mail.yahoo.com ebillpay.verizonwireless.com info.com inventionconcept.com freecreditreport.com viewpoints.comcbs.com movies.yahoo.com verizonwireless.com arcamax.com forms.earnmydegree.com startsampling.comwww5.jcpenney.comhsn.com ssa.gov shopathome.com medicinenet.com usmagazine.com www2.jcpenney.com cooks.com oldnavy.gap.com buddytv.com download.cnet.com videogames.yahoo.com shopping.yahoo.com login.verizonwireless.com yahoo.com fancast.com www.yahoo.com job.com ezinearticles.com att.com vistaprint.com target.com jcpenney.com bricks.coupons.com geo.craigslist.org netflix.comshopzilla.com bbb.org officedepot.com macys.com fedex.com webmd.com wikipedia.org en.wikipedia.org craigslist.org articlesbase.combing.com radioshack.com weather.yahoo.com secure.classmates.com apple.com realestate.yahoo.com stores.ebay.com wisegeek.com dw.weather.commylife.comnbc.com irs.gov walgreens.com legacy.comprint.coupons.com everydayhealth.com abc.go.com southernfood.about.com creatives.livejasmin.com login.live.com microsoft.com smi.usps.com blockbuster.com gevalia.com associatedcontent.com coupons2.smartsource.com motors.ebay.com adobe.com myworld.ebay.com desktopfw.weather.com mahalo.com tv.yahoo.com search.aol.com dexknows.com foodnetwork.com addthis.com tube8.com checkoutfree.com people.com www.mozilla.com post.craigslist.orgmail.live.com accounts.craigslist.org itunes.apple.com merriam−webster.com peoplefinders.com offer.ebay.com health.yahoo.com staples.com superpages.com merchantcircle.com www2.victoriassecret.com voap.weather.com hgtv.commayoclinic.com dailymotion.com en.allexperts.com r.msn.com paypal.com bizrate.comsites.target.com wellsfargo.com zazzle.com pbs.org whitepages.com ancestry.com toysrus.com orientaltrading.com pages.ebay.com www22.verizon.com shop.ebay.com simplyink.com online.wellsfargo.com ussearch.com thefreedictionary.com store.yahoo.net lifestyle.msn.com metacafe.com search.mylife.com catalog.ebay.com hp.com my.yahoo.com msn.com blogger.com directv.com sears.com samsclub.com cvs.com allrecipes.com kohls.com yelp.comaolhealth.com netquote.comone−time−offer.com moviefone.com office.microsoft.com etsy.com fandango.com sitekey.bankofamerica.com comcast.com eonline.com autotrader.com google.com bestbuy.com classmates.com nextag.com popeater.com ehow.com personals.yahoo.com digg.com maps.google.com travel.yahoo.com news.yahoo.com pandora.combankofamerica.com mypoints.com search.barnesandnoble.com usps.com capitalone.comyellowpages.superpages.com onlineeast3.bankofamerica.com zappos.com wonderwall.msn.com support.microsoft.com onlineeast2.bankofamerica.com cgi.ebay.com onlineeast1.bankofamerica.com web.aol.com picasaweb.google.com health.msn.com maps.yahoo.com careerbuilder.com imdb.com ebay.com signin.ebay.com aol.com mapquest.com television.aol.com buzz.yahoo.com offers.bankofamerica.com stylelist.com priceline.com eharmony.com specials.msn.com webmail.aol.com overstock.com my.ebay.com indeed.com vap.yahoo.net wwwapps.ups.com hosted.where2getit.com amazon.com mail.aol.com cgi1.ebay.com hotwire.com chase.com retailmenot.com nfl.com history.paypal.commovies.msn.com chaseonline.chase.com screenname.aol.comservicing.capitalone.com ups.com mercurymagazines.com news.aol.com store.apple.com askville.amazon.com flickr.com mlt0.google.com bbc.co.uk docs.google.com homedepot.com tgifridays.com gima.weather.com barnesandnoble.com bedbathandbeyond.com recipezaar.com drugstore.com adultfriendfinder.com evony.com kbb.com mwfb.zynga.comcontact.ebay.com payments.ebay.com walletpop.com tv.msn.com ftd.com mail.google.com dailymail.co.uk cgi5.ebay.com feedback.ebay.comcbsnews.com servicemagic.com mycokerewards.com abcnews.go.com books.google.com dell.com monster.com comcast.net tmz.com payments.chase.com manta.com costco.com thefind.com ticketmaster.com hotels.com lowes.comexaminer.com youporn.com travel.travelocity.com travela.priceline.com fixya.com jobsearch.monster.com realtor.com travelocity.com expedia.com city−data.com groups.yahoo.com login.comcast.net shopping.hp.com mt0.google.com simplyhired.com sites.google.com clients.google.com snopes.com magazines.com justanswer.com break.com forbes.com orbitz.com stmts.chase.com accountonline.com evite.com wikihow.com us.dell.com kodakgallery.com news.google.com weather.com discovercard.com cards.chase.com buy.com new.facebook.com jobview.monster.com match.com southwest.com sports.yahoo.com bidcactus.com restaurant.com msnbc.msn.com wunderground.com huffingtonpost.com edmunds.com rivals.yahoo.com nytimes.com reviews.cnet.com time.com espn.go.com washingtonpost.com tripadvisor.com nydailynews.com cnn.com msn.foxsports.com delta.com foxnews.com online.wsj.com mlb.mlb.com finance.yahoo.com usatoday.com money.cnn.com moneycentral.msn.com linkedin.com boston.com Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 19 / 42
- 27. Group-level activity How does browsing activity vary at the group level? College Female Over 25 70 Non−White q q q 60 Daily Per−Capita Pageviews q White No College 50 40 Male 30 Under 25 20 10 0 Race Education Sex Age Large differences exist even at the aggregate level (e.g. women on average generate 40% more pageviews than men) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 20 / 42
- 28. Jake Hofman Percent of Total Time Spent on Site 0.1% 1% 10% fa m ce ai bo l.y o ap k ps g aho .co .fa oo o. m m ce gl co ai b e. m l.g oo co o m m og k.co a le m y il. .c vi c web ou live om ew h m m tu .c m an w ai be om or ne fb l.a .co ep l.f .zy ol m ic ac ng .co se s.m ebo a.c m ar ys ok om (hofman@yahoo-inc.com) ch pa .c . c o m yah e.c m ys o o pa o.c m Group-level activity ce om a m .c sh ma sn om op zo .co im .e n. m ho age y bay com m s. ah .c e. go oo om m my og .co ai sp le m l.c a .c om ce om w c .c w b as om m w in t.n .y g e es sa cg ah .co t gi i.e oo m ng es ba .co .m pn y. m ys .g com p o. ci twace com m i .c .m tte o e r m fa en my eb .co ce . .e o m bo lo wik ba .co ok gin ipe y.c m .m .y di om af ah a. m ia oo or fri ga y. wa .co g en m ya rs m ds e3 ho .co Learning from Web Activity .m .p o. m ys og co o m w ta pac .co or g e m ld ge .co w d m in .c m ne o lo ee r.c m g b o m my in.li o.c m ap p ve om s. oin .c go ts om og .c m le om w a .c m p ol. om ne s.z og co w yn o.c m fa s. g o email, search, and social networking sites nt ya a m as w ho .com ys in o po n ste .co rts et r.c m se a .y flix om ar ho .co ch o m . al co .ao com ot m l.c m ca o et s m ric t.n s. et male co m female JSM, 2011.08.01 All groups spend more than a third of their time on a handful of 21 / 42
- 29. Jake Hofman Percent of Total Time Spent on Site 0.1% 1% 10% fa m ce ai bo l.y o ap k ps g aho .co .fa oo o. m m ce gl co ai b e. m l.g oo co o m m og k.co a le m y il. .c vi c web ou live om ew h m m tu .c m an w ai be om or ne fb l.a .co ep l.f .zy ol m ic ac ng .co se s.m ebo a.c m ar ys ok om (hofman@yahoo-inc.com) ch pa .c . c o m yah e.c m ys o o pa o.c m Group-level activity ce om a m .c sh ma sn om op zo .co im .e n. m ho age y bay com m s. ah .c e. go oo om m my og .co ai sp le m l.c a .c om ce om w c .c w b as om m w in t.n .y g e es sa cg ah .co t gi i.e oo m ng es ba .co .m pn y. m ys .g com p o. ci twace com m i .c .m tte o e r m fa en my eb .co ce . .e o m bo lo wik ba .co ok gin ipe y.c m .m .y di om af ah a. m ia oo or fri ga y. wa .co g en m ya rs m ds e3 ho .co Learning from Web Activity .m .p o. m ys og co o m w ta pac .co or g e m ld ge .co w d m in .c m ne o lo ee r.c m g b o m my in.li o.c m ap p ve om s. oin .c go ts om og .c m le om w a .c m p ol. om ne s.z og co w yn o.c m fa s. g o ya a m nt as w ho .com universally popular and on more niche sites ys in o po n ste .co rts et r.c m se a .y flix om ar ho .co ch o m . al co .ao com ot m l.c m ca o et s m ric t.n white s. et co m non.white But different groups distribute their time differently, both on JSM, 2011.08.01 21 / 42
- 30. Jake Hofman Percent of Total Time Spent on Site 0.1% 1% 10% 0.1% 1% 10% 0.1% 1% 10% 0.1% 1% 10% 0.1% 1% 10% fa c m eb ail oo .y k. ap ah co ps go oo m .fa og .co m ceb le. m ail o co .g ok m o .c m ogle om ail . .li co w you ve. m e t c vie ch m bm ube om w an wf ail. .co m n b ao m or el. .zy l. ep fa n co ic ce ga m s b .c se .my oo om ar sp k.c ch ac o (hofman@yahoo-inc.com) .y e m m aho .com ys o pa .co ce m .c am msn om sh az .c op on om im .e .c b o ag y ay m ho es ah .co m .g oo m e. oo .c m o m ys gle m ail pa .co .c ce m om .c ca om w st w b .n w in e .y g. t m a es cg ho com sa i. o. gin e eba com g. spn y.c m .g om ys o pa .co c m cim tw e.c .m itter om e . m e co en y.e bo. m fa c ce lo .wik bay om bo g ip .c ok in. ed om .m ya ia. af ho org ia o m wa .co y frie gam .ya rs.c m nd e3 ho om Learning from Web Activity s. .p o.c m og om ys o pa .co w ta ce. m or gg c ld e om w d. in co m ner m . lo eeb com gin o .c m my .live om ap po .c s. int om go s. og co le m . m a co w p ol.c m m o o ne s.z go. m w yn co s. ga m ya .c fa h o nt w oo m as in .c ys s o po n ter. m rts etf co se ah c.y lix. m ar o om ch o.c .a om alo com ol.c tm ca om et st. ric ne s. t co m JSM, 2011.08.01 Income Education Race Sex Age 22 / 42
- 31. Jake Hofman M Female−to−male pageview ratio ult i− 0.5 1 2 ca te g FA H ory amppa o H lid Ho ily rel/ ea ay m Re B M lth s e e ult , F& S & souaut q i− itn p Fa rcey q M ca e e s s Foss cial hion q ult te i− go od & EvPe q ca ry te P & Nut ents q go Spe ho Co ritiots ry H cia N tog ok n qq Fa o l Oon ra ing M milme cc−P phy em y & a ro q q & G sio fit M be q Sh as r C Lifeard ns q s o sty en op M q pin G ermm Bo les g re ch u ok q et a nit s EdDir in n ie uc ec Geg Cdis s qq at tor Un ne a er io ie iv rd q R Cor na s & eralo s q ea p G l R s gy l E ora ifts e Gu itie (hofman@yahoo-inc.com) q st te & so ides M q at In F ur s ult q i− Kid e/A for lowces q Fu ca D s, parma ers te G tm tio Group-level activity ll go ire am e n Se ry ct n qq rv or O Go eE−m ts ic F Te ie n v s, a e ull le Cous/L lineern Toy il C S co pooca G me s om e m C n l a n m rvic /In e s G m t er e te llu /R uides qq qq cia B rn la ew e q l Ban et r/P ar s q G anks Cru Se ag ds is r in q en ks & C I e vic g q er R & Crednsu Lines al eli q In re it ra es gio d U n te q re n it Unioce st M Bro & n n Po ult ad Sp Loions qq So rt i− Dca irit ans q ftwals ca e st ua s q ar & teg stinMe lity e Co or a dia q y q D Ma mm Ttion eli nu ra s v f u v q M Ho Arery actnitieel ult te ts /S ur s e qq Lo i−c ls/H Cr/Gr tam rs q ng at o ed aph ps D ego Matel it ic is ry p D S Ca s ta q q s/ ire ea rd nc En Tr c rc t q C e/L ter aveorieh M q ar M ult ee ocatain l In s m q ult i− i− ca C r D l Ca efo q la F ev A r nt ca te s in r q te go Fr sifieanelo irlinier go q ry ee d cia pm es ry N s l e Fin ew Me /Au To nt qq s rch ctiools Learning from Web Activity C anc G ur e r In & I and ns re /In ou s nf E is qq nt s n tan ormve e q Ev ura d T t M a nts en nc ra e tio q M ts e ns ss I n ult i− In Sp & /Inv po agSP te G r in ca qq rn ecia loest tatiog te e b m q go G t To l In al Nen n q ry am o te e ts C Ta bli ls/W res Muws om r ng e Wt N s qq puget Ha /S b e ewic C te ed rd Re w Se at s rs P w om seee rv he q q pu & or ar a p ic r te Au Cotalse M rchsta es r& to ns & an T kes m um C u M oo C qq q ot e o fa ilit ls M on ive r m ctu ar m q ult s M E u re y i− Mu um q C V a lec n rs at lti− er idenuf troities eg A ca Ele W o ac nic q q or uto te c e s/M tu s q Fin y m go tro b o re an Edu otivry nicHosvie r cia Pa ca e Au s N tin s qq l N rts tio Inf tom ewg q ew & n &orm ot s q s Ac C at ive & c a io q In es ree n q fo so r rm ries q O P H atio s nli e u n q ne rs m q Tr onaor a ls q Spdin q o g q Adrts ult q JSM, 2011.08.01 23 / 42
- 32. Group-level activity There is both reasonable overlap and variation amongst the most popular sites within groups. Over/Under 25 q Years Old Female/Male q Under/Over $50,000 q Household Income White/Non−White q College/No College q 0.0 0.2 0.4 0.6 0.8 1.0 Jaccard Similarity Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 24 / 42
- 33. Individual-level prediction How well can one predict an individual’s demographics from their browsing activity? • Represent each user by the set of sites visited • Fit linear models3 to predict majority/minority for each attribute on 80% of users • Tune model parameters using a 10% validation set • Evaluate final performance on held-out 10% test set 3 Using SVM-perf Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 25 / 42
- 34. Individual-level prediction Reasonable (∼70-85%) accuracy and AUC across all attributes AUC Accuracy Over/Under 25 q q Years Old Female/Male q q White/Non−White q q Under/Over $50,000 q q Household Income College/No College q q .5 .6 .7 .8 .9 1 .5 .6 .7 .8 .9 1 Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 26 / 42
- 35. Individual-level prediction Highly-weighted sites under the fitted models Large positive weight Large negative weight winster.com sports.yahoo.com Female lancome-usa.com espn.go.com marlboro.com mediatakeout.com White cmt.com bet.com news.yahoo.com youtube.com College Educated linkedin.com myspace.com evite.com addictinggames.com Over 25 Years Old classmates.com youtube.com Household Income eharmony.com rownine.com Under $50,000 tracfone.com matrixdirect.com Table 2: A selection of the most predictive (i.e., most highly weighted) sites for each classification task. AUC Accuracy Figure 7, a measure that effectively re-normalizes the ma- Over/Under 25 Years Old ! ! jority and minority classes to have equal size. Intuitively, Female/Male ! ! AUC is the probability that a model scores a randomly se- lected positive example higher than a randomly selected neg- White/Non−White ! ! ative one (e.g., the probability that the model correctly dis- Under/Over $50,000 Household Income ! ! tinguishes between a randomly selected female and male). College/No College ! ! Though an uninformative rule would correctly discriminate Jake Hofman (hofman@yahoo-inc.com) .5 .6 .7 .8 .9 1 .5 .6 .7 Learning1 from Web Activity pairs 50% of the time, predictions based on 27 / 42 .8 .9 between such JSM, 2011.08.01
- 36. Individual-level prediction Similar performance even when restricted to top 1k sites 0.9 0.9 q q q q q 0.8 0.8 q q q Accuracy 0.7 0.7 AUC q Age q Age Sex Sex 0.6 0.6 Race Race Education Education Income Income 0.5 0.5 102 102.5 103 103.5 104 104.5 105 102 102.5 103 103.5 104 104.5 105 Number of Domains Number of Domains Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 28 / 42
- 37. Individual-level prediction Substantially better performance when restricted to “stereotypical” users (∼80-90%) 0.95 0.95 q q 0.90 q 0.90 q q qq qq 0.85 0.85 q Accuracy q AUC q qq qq 0.80 0.80 q Age q Age Sex Sex 0.75 Race 0.75 Race Education Education 0.70 Income 0.70 Income 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 Fraction of Users Fraction of Users Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 29 / 42
- 38. Individual-level prediction Proof of concept browser demo http://bit.ly/surfpreds Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 30 / 42
- 39. Demographics diversity onthe Web with Irmak Sirer and Sharad Goel The real story (what we actually did) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 31 / 42
- 40. The real story 0. Got several hundred GBs of MegaPanel data from Nielsen4 , looked at a small sample # ls -alh nielsen_megapanel.tar -rw-r--r-- 100G Jul 17 13:00 nielsen_megapanel.tar 4 Special thanks to Mainak Mazumdar Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 32 / 42
- 41. The real story 1. Discussed (many) possible projects • Infer the number of individuals using the same browser or behind the same ip? • Determine number of actual uniques advertisers are receiving? • Predict user demographics from a few minutes of browsing activity for ad-targeting? Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 33 / 42
- 42. The real story 2. Modeled real-valued age as a function of site visits • Worked on this for an embarassingly long time • Tried various options for cleaning and normalizing data (100GB → ∼5GB) • Investigated several methods for feature selection (e.g., naive Bayes, mutual information, popularity ) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 34 / 42
- 43. Hadoop + Pig(+ awk) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 35 / 42
- 44. The real story 3. Settled for classification of binary outcomes (e.g. adult/non-adult) • 265,000 users (examples) and 100,000 sites (features) • Logistic regression in R, e.g. model <- glm(is.adult ~ ., data=nielsen, family=binomial) ??? Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 36 / 42
- 45. The real story 3. Settled for classification of binary outcomes (e.g. adult/non-adult) y (xi ) = w · xi + b ˆ Support Vector Machine : L(y , y ) = C ˆ i [1 − yi y (xi )]+ + ||w ||2 ˆ Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 37 / 42
- 46. The real story 4. Investigated why classification worked reasonably well • Generated descriptive statistics across all attributes at the site and group levels • Compared site statistics to ZIP code data from the US Census • Compared time distribution across groups Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 38 / 42
- 47. The real story 5. Realized that we now had one of the most comprehensive studies available on demographic diversity of the web Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 39 / 42
- 48. Conclusion (lessons learned) Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 40 / 42
- 49. Lessons learned Data jeopardy Regardless of scale, it’s difficult to find the right questions to ask of the data Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 41 / 42
- 50. Lessons learned Rapid iteration The ability to iterate quickly, asking and answering many questions, is crucial Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 41 / 42
- 51. Lessons learned Data cleaning Cleaning and normalizing data is a substantial amount of the work Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 41 / 42
- 52. Lessons learned Modeling Simple methods (e.g., linear models) work surprisingly well, especially with lots of data Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 41 / 42
- 53. Lessons learned It’s easy to cover your tracks—things are often much more complicated than they appear Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 41 / 42
- 54. Thanks. Questions? http://messymatters.com/webdemo http://jakehofman.com hofman@yahoo-inc.com Jake Hofman (hofman@yahoo-inc.com) Learning from Web Activity JSM, 2011.08.01 42 / 42