To Thesis or Not to Thesis?:
That is the Question (or the Hypothesis)
A Directed Study of Statement Tag Distribution in a Technical Communication Database
Introduction
Mary Sue MacNealy (1998) states “recently the academic community has begun to move toward interdisciplinary studies. This movement has been particularly strong in the writing discipline” (p. 5). Emerging from various disciplines such as literary study and social science, technical communication and composition have adopted different methodologies for how research is conducted and the ways in which it is reported. After reading multiple articles in technical communication publications, I noticed a trend in the way research statements were included. Often, when technical communication scholars reported their research findings, their studies included both a thesis and a research question or hypothesis. This directed study, using the materials provided in the English 5363 Article Database, is an inquiry into the following question: how often will research reports/articles be identified as having both a thesis and hypothesis or a thesis and a research question? This report details my findings.
Methodology
To answer this question, I used a sample of technical communication and composition research articles compiled in the “5363 Article Library” in a group database housed in Zotero. These articles were compiled and tagged by Dr. Cargile Cook and Dr. Rickly’s English 5363 “Research Methods in Technical Communication” graduate students during fall 2010. All students were required to select a journal issue from a technical communication or composition journal, submit article analyses, and tag articles in Zotero using Cargile Cook and Rickly’s “Research Article Coding/Tagging Schema” (2010). There were 19 total students who contributed to the database and all of the articles tagged were cross-checked by at least two class members.
This directed study into how statement tags were distributed was performed on 10 October 2010. On this date, there were 134 articles in the English 5363 database. I eliminated all articles without tags (these were articles included in the database, but not part of the database class study). I did this by transferring all database articles into a new Zotero folder and reviewing all article records for tags. If there were no class documented tags, I deleted the entry from my study folder.
The total sample size of articles with tags was 84. Since my goal was to see overlaps in the data, I sorted articles based on the “Research Article Coding/Tagging Schema” which listed the following statement tags: statement>hypothesis, statement>thesis, statement>question, statement>other, and statement>not reported. The results of each search were copied into an Excel spreadsheet field under the appropriate tag label. When I reviewed my initial results, I noticed that only 70 articles were tagged: 14 articles were missing. I searched all articles and found that these 14 articles were missing statement tags. Thus, I included a final category not found in the tagging schema, but important to the analysis of the database. I put the 14 articles with missing statement tags into a “no statement tag” category. Once the results of all searches were entered into the excel file, I looked for articles that appeared in different statement tag fields (which I sorted alphabetically).
Once all data was compiled in the Excel spreadsheet, I was able to calculate the total number of articles per tag designation and look for trends in the distribution of these tags.
Results
The results show that the most commonly used statement tags used in the English 5363 database articles are thesis statements and research questions as detailed in Figure 1.
As demonstrated in Figure 2, of the 84 articles only 8 articles had more than one statement tag. Thus, it does not appear that having multiple tags, or statements, is a norm amongst the authors in this database. Furthermore, in all 8 articles with more than one tag, the statement tag included statement>question and statement>thesis as seen in Figure 3. This correlation implies that authors using both a thesis and a question, see the question as leading to a thesis. Blakeslee and Spilka (2004) use Charney’s assertion that “researchers sometimes approach their work with particular questions in mind: They assume that the projects will take shape during field work or when they finally analyze data” (p. 77). This observation suggests that researchers in our field may use a research question as a means of developing a thesis. As a research report is being written, the thesis is acknowledged, perhaps as an influence of the humanities, in the beginning of a report as well as the research question that guided the information. It is important to note, however, that although there was a relationship between research questions and theses, the combination of the two tags is only observed in 10% of the database articles.
Discussion
This study cannot generalize the overall practice of the field because of limitations to the study. One limitation is that many articles in the sample were not coded with a statement tag, although all categories in the tagging schema were supposed to be used when tagging/coding an article according to the directions provided by the professors of English 5363. It is also not clear why some participants chose not to include a statement tag when one of the options on the tagging schema was statement>not reported. We must take into consideration that 14 of the articles (or 16% of the total sample) were not given a statement tag and thus we must question if those 14 articles were correctly read and analyzed. Clearly, leaving 16% of the articles untagged for the research statement could skew the findings of this study.
Another limitation to this study is the varying competency of tagging amongst the participants of the database project. Although all tagging was to be cross-checked by at least 2 other members of the project, there were problems with consistency in tagging likely due to the level of instruction and experience of participants in tagging articles throughout the project. Six of the participants were onsite PhD students who had double the class time as the remaining thirteen online students, thus giving them more instruction and access to instructor and peer assistance than online students. However, it should be noted, that groups of three were designed to cross-check each other’s articles, and these groups each included one onsite student to two online students. These groupings may have alleviated the potential for error, but this cannot be guaranteed.
We must also consider sample size as a limitation of this study. 84 articles that were not randomly selected and represented only a two year period of writing literature (and, of course, we could not cover all issues of all technical communication and composition journals in this two year period) gives only a small representation of the scholarship in the field. Thus, a generalization of how authors in technical communication and composition state the purpose of their research in their reporting cannot be made until a larger sample is retested at a later time.
Finally, the technological hiccups with Zotero could also have affected results. Zotero, tended to drop tags making it necessary to re-enter tags throughout the project. There is no guarantee that the final results were not affected by this glitch, nor can we be certain that tags were re-added to the database accurately.
Despite the limitations above, we can see interesting trends within the database that are important to retest with different samples. The data suggests that in my sample of technical communication and composition research publications, the authors combine a thesis with a research question occasionally, but it does not seem to be a wide spread practice. However, since multiple tags are isolated to these two statements, we must question the implications of this finding. We may explain the use of both research statements as a way of marrying the humanities with the social sciences: conforming to “theory” and “empiricism.” This interdisciplinary focus to our research certainly implies a break (or stretching) of our literary roots. Looking at how technical communication and composition take this interdisciplinary approach as a field can give us insight as to how we evolve in defining our mission and scholarship.
The lack of multiple statement tagging also implies a sort of resistance. The first part of my research question, “how often will a thesis be combined with a hypothesis?” found that there were no correlations between a thesis statement and a hypothesis in the database. This may speak to the level of science/experimental research infiltrating the discipline. The number of hypotheses in the statement tags was lower than the thesis, question, and no statement tag designations. This brings in many questions as to the nature of the research being seen in our field. If we are more empirical now than we have been in the past, are we focusing more on qualitative than quantitative? If so, what does this say about the nature or movement of the field? This may also be a sign of weariness on the part of scholars about merging theory with experimentation or quantitative inquiry. Or, in other words, the field wants to stretch beyond its literary roots—but not too much.
Conclusion
This study could not make a definitive claim about how writers in writing studies research use research statements. However, this study does show the necessity of repeating the research with new data sets. This question in particular can provide insight into how research reporting reflects the values of the field and how we as a discipline, consciously or unconsciously, define ourselves in our research reporting choices.
References
Blakeslee, A. M., & Spilka, R. (2004). The state of research in technical communication. Technical communication quarterly, 13(1), 73–92.
Cargile Cook, K., & Rickly, R. (2010). Research Article Coding/Tagging Schema. Retrieved from https://moodle.english.ttu.edu/mod/forum/discuss.php?d=1264
MacNealy, M. S. (1998). Strategies for Empirical Research in Writing. Boston: Longman.