This document discusses key issues researchers face when conducting social science research using social media data. It addresses questions around appropriate quantitative and qualitative methods for analyzing different social media like Facebook and YouTube. It also discusses ethical issues around permission, anonymity, and credibility of social media data. Researchers must determine the best methods for new data sources while addressing validity, generalizability, and how well existing human research paradigms apply to publicly available online data.