Using natural language processing for qualitative data analysis

TitleUsing natural language processing for qualitative data analysis
Publication TypeJournal Article
Year of Publication2012
AuthorsCrowston, K., Allen E. E., & Heckman R.
JournalInternational Journal of Social Research Methodology
Start Page523-543
Date Published2012
KeywordsFLOSS, NLP

Social researchers often apply qualitative research methods to study groups and their communications artefacts. The use of computer-mediated communications has dramatically increased the volume of text available, but coding such text requires considerable manual effort. We discuss how systems that process text in human languages (i.e., natural language processing, NLP) might partially automate content analysis by extracting theoretical evidence. We present a case study of the use of NLP for qualitative analysis in which the NLP rules showed good performance on a number of codes. With the current level of performance, use of an NLP system could reduce the amount of text to be examined by a human coder by an order of magnitude or more, potentially increasing the speed of coding by a comparable degree. The paper is significant as it is one of the first to demonstrate the use of high-level NLP techniques for qualitative data analysis.

NLP_for_qualitative_analysis.pdf315.93 KB