February 20, 2013

Boote & Beile (2005) take-aways

I am preparing a conference proposal based on a historical review of the literature I wrote last semester for one of my comprehensive exam questions, a question I had proposed in collaboration with my committee. I wanted to trace the origins of the conceptual construct known as TPACK (Technological Pedagogical Content Knowledge) because I thought it would be a major aspect of my dissertation frameworks.

Conducting the TPACK literature review taught me a lot -- mainly that I did not want to focus on TPACK! I decided that the current state of teacher development as it relates to the new literacies is less a problem framed by cognition (as in, developing TPACK) and more a problem with dispositions and mindsets toward new digital technologies. In other words, when teaching about and through 21st century technologies, we fail to acknowledge the fear and sense of disequilibrium that gives rise to the initial resistance among even the most gung-ho learners.

Still. I am pretty happy with the final outcome of the review. I enjoyed writing it and don't want my efforts to go to waste. I see value in the TPACK construct in that it provides a common language for researchers and teacher educators, and I found interesting intersections in the literature between the TPACK and new literacies discourse communities. So, I am going to submit my review of the TPACK literature to this year's Literacy Research Association conference in hopes of striking a chord with the niche group of new literacies teacher educators who annually attend.

Before doing so, I would not object if someone gave my TPACK review the once-over with the evaluation framework Boote and Beile (2005) devised for their analysis of doctoral literature reviews in education.

Boote and Beile pull no punches in their harsh assessment of the state of the literature review, and I wonder how my TPACK document would hold up to their standards, particularly the methodology criteria. To my knowledge, I did not describe the advantages and disadvantages of primary methodologies used in the field of teacher education and instructional technology, except to note the preponderance of quantitative studies and their ineffectiveness in "measuring" change in the affective domain. And that is teetering on the edge of the pitfall known as the "negative logic-of-justification" (Piantanida & Garman, 2009, Ch. 11, "Preparing to construct a logic-of-justification," para 4).

Take-away: I need to maintain a steady focus on the "pockets of discourse" where scholars are connecting on particular qualitative approaches (i.e. fruitful connections between Cultural-Historical Activity Theory and the New Literacies perspective).

Bridging, not filling, gaps
Approaching the literature review is an exercise in making connections as much as the actual writing of the review itself. Before I began the process of "immersion in literature" (Piantanida & Garman, 2009), I had already oriented to my topic of interest based on a combination of worldview and practical and professional experience. Boote and Beile (2005), Kilbourn (2006), and Piantanida and Garman all argue this point.
from FreeDigitalPhotos.net

Kilbourn, for instance, says we don't so much "find" topics as we "construct" or "develop" them. He says, "Problems are usually constructed out of a complex interplay among one's own thinking about an issue, one's own experience, and one's understanding of the research literature" (p. 539).

What we identify as a worthwhile problem to pursue is partly determined by our own thinking, experience, and reading of the literature. It is highly subjective.

And Piantanida and Garman explain, "...[P]atterns of meaning are not embedded in the literature per se, but are forged in relation to the nagging issues that are pushing and prodding one toward a picture of one's study" (Ch. 10, "Developing a Mindset for Reviewing Literature," para 1). Moreover, the patterns and connections help clarify "how one's ideas fit into an evolving discourse about the topic" (para 4).

A good lit review is not just a summary of research; it is the foundation upon which the researcher puts forth his or her unique perspective.

However, in their assessment of 12 dissertations from three state-funded institutions, Boote and Beile found evidence to suggest that, for many doctoral students and their advisers, the literature review is a "hollow exercise" (p. 9). The review is treated as a means to an end, rather than an end in itself. We engage with the literature only long enough to find "the gap" that will justify our own study. Piantanida and Garman would call it just more academic folklore, a "misinterpretation of the expectation that the dissertation be an original piece of research" (Ch. 10, "Developing a Mindset for Reviewing Literature," para 3).

This misrepresentation is alive and well among my classmates and colleagues. Where do we get the idea that this is the purpose of the review? I certainly believed it, and I remember feeling envious when friends breathlessly delivered the news that they had finally "found a gap" in the literature for their dissertations. How many of us in our own reviews of the literature have skipped the discourse altogether, impatiently scrolling (or turning) the pages until we could rest our eyes on the all-important "findings" and "recommendations" sections of this-or-that study? We test the waters, rather than immerse ourselves in the discourse.

Take-away: Stop looking for gaps and look for opportunities to contribute to the ongoing deliberations on a topic within my field. My study should not propose to fill a gap; it should make connections across and between gaps.

"Crafting discursive text"
Piatanida and Garman describe the period of reading the literature as a time marked by confusion and feelings of incompetence. The incredible "Henny Penny" anecdote from Chapter 8 again comes to mind and should be required reading for all who are about to embark on the lit review journey.

Piantanida and Garman advise, "It is important to give oneself time to enter into the discourses, to read without necessarily understanding, and finally to read with enough understanding to begin crafting discursive text for the proposal" (Ch. 10, "Developing a Mindset for Reviewing the Literature, para 1).

By way of a somewhat tedious lawnmower repair metaphor, Kilbourn makes a similar point. He explains that the literature review is the route to writing the all-important problem statement (or Piantanida and Garman's "statement of intent"). Kilbourn says, "An educational problem gets translated into a research problem (1) when it is couched in an argument (an argument, not merely an assertion) that illustrates its educational significance and (2) when it explicitly refers to existing research" (p. 541).

The literature review, then, is integral to the study, not merely "tacked on," but interwoven in the context, motivation, and significance (Kilbourn, 2006). Kilbourn writes, "Articulating the problem in the proposal is one of the more difficult stages of a dissertation, one of the sweaty inclines" (p. 539).
from FreeDigitalPhotos.net

I think the TPACK review did this for me. It pointed me to the less-understood phenomenon of teacher identity in relation to classroom technology integration. It goaded me to formulate a clear and (I hope) convincing rationale for the focus of my research.

So, contrary to popular belief, the literature review should not be put off until after the problem and methods are defined, nor should it be set aside as a "static artifact" upon completion (Boote & Beile, 2005, p. 11). This last bit of advice from Boote and Beile gave me pause because I really have not looked at my literature since submitting my proposal almost two months ago.

Take-away: Treat my dissertation literature review as a living, breathing document and stay engaged with the literature throughout the dissertation process.

References:

Boote, D. N., & Beile, P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation. Educational Researcher, 34(6), 3–15. doi:10.3102/0013189X034006003
Kilbourn, B. (2006). The qualitative doctoral dissertation proposal. The Teachers College Record, 108(4), 529–576.
Piantanida, M., & Garman, N. B. (2009). The qualitative dissertation: A guide for students and faculty (2nd ed., Kindle version.). Thousand Oaks, CA: Corwin.

Share/Bookmark

February 13, 2013

Perspicacity or paint-by-numbers?

Good research is not about good methods as much as it is about good thinking. (Stake, 1995, p. 19)


Writing is thinking on paper. -- William Zinnser

Perspicacity 1936

For a Tuesday night class, I was asked to lead discussion on a reading selection about case study research in the field of literacy.

This was a prime opportunity, as I am in the middle of a self-directed, crash course on case study methodology for my own dissertation. Remembering the advice of a former university instructor who said that presenting a formal, scholarly talk on a subject is good preparation for the eventual task of academic writing, I used this occasion to sort out my nascent understandings of the case study literature, namely the works of two leading methodologists, Stake (1995) and Yin (2008).

First, to catch everyone up: Although I already have written and defended a dissertation proposal, I feel my research design, which includes case study, is flimsy. I proposed a project using Cultural-Historical Activity Theory (CHAT) and activity systems analysis within a case study, but I am not at all versed in case study method. In my proposal I devoted my time to a thorough treatment of CHAT, which is a substantive theoretical and analytical frameworks that does not provide a clear logic of design. Thus, in the literature, you will encounter CHAT theorists who specialize in other methods, such as design-based research, ethnography, and case study.

So, in consultation with my professors, I decided that part of my work this semester -- even as I am actively collecting data and beginning initial analysis -- would be to take a closer look at the case study tradition and develop an appropriate "logic-of-justification" (Piantanida & Garman, 2009) for its use in my study.

I began the presentation on Tuesday evening with the above quote from Stake and an image from Rene Magritte, whose artwork Stake references both on the cover and in Chapter 6 of his 1995 book, The Art of Case Study Research.

I loved Chapter 6 of this book. Stake demonstrates how epistemology is expressed through multiple overlapping and intertwined researcher identities: teacher, participant observer, interviewer, reader, storyteller, advocate, artist, counselor, evaluator, consultant. The researcher is all of these, but his or her "style" determines the emphasis given each role.

In a section titled "Case Researcher as Interpreter," Stake argues that "research is not just the domain of scientists, it is the domain of craftspersons and artists as well, all who would study and interpret" (p. 97). He connects case study to the Surrealist Magritte, who juxtaposed everyday images to make assertions about the world and humanity. "Magritte worked his white clouds against luminous blue sky again and again, drawing attention to ourselves as creators of meaning -- and to the artist as our agent, helping us toward new realizations" (p. 98).

I enjoyed Stake's discussion about "researcher as interpreter" and decided to include a bit of that in my presentation on Tuesday. I selected Magritte's Perspiracity as a discussion starter. I had to look up this word, which means "acute mental vision and discernment." I thought this connected nicely with Piantanida and Garman's discussion around the concept of phronesis, the wisdom and "theoretic perspective" that guides the researcher "toward a form of representation that can convey the complexity of the phenomenon clearly and persuasively" (Ch. 13, Warranting a Thesis, para 3). Stake simply called it "good thinking."

[Confession: As I browsed thumbnails of Magritte's art on the Internet, my initial reaction to the image of the stiff man in a suit painting a bird while studying what appears to be a common chicken egg was, "How sad, uninspired, and predictable." Maybe Magritte's title is a tongue-in-cheek joke? Still. Some scholars in the UK, at least, also made the Perspicacity and phronesis connection, as evidenced by the book cover to the right, shared with me by a classmate just this morning! Wild, huh?]


For the presentation on case study, I wanted to do something more than just deliver a tired, bullet-pointed explication of methodological conventions. So, I delivered a tired, bullet-pointed explication of methodological conventions -- with a twist. I tried framing the presentation (embedded below) as my personal process of constructing a logic-of-justification.

One idea, in particular, that I wanted to put out there is the novice researcher's struggle to break out on his or her own while self-consciously clinging to "prescriptive formulas" (Piantanida & Garman). This theme came out in full at the end of the presentation, during Q&A time, when I shared some of my own questions:

  • Which perspective on case study (Stake, Yin, others???) is a good epistemological fit for my project? Do I need to align with one perspective? By paragraph three of his introduction, Yin already sounds more objectivist than Stake, using terms like "validity" and "chain of evidence." Also, in answer to the question, "How does one know to use case study?" Yin writes, "There's no formula, but your choice depends in large part on your research question(s)." This is opposite of an interpretivist mindset that would say the researcher's proclivities and epistemology determine the method/approach.
  •  Where does the rich, narrative description (experiential text) of case study fit into a CHAT dissertation? As a stand-alone chapter?
I cannot help it. The novice in me craves scaffolds and step-by-step guidelines, which imposes a significant (productive?) tension vis-a-vis my desire to say and do something innovative and original. I am gripped by these competing mindsets (not to mention what a ticking clock and dwindling bank account are doing to my willingness to invest an "extra year" in the name of "scholarly integrity and perseverance.")

My project resides on a continuum, somewhere between masterpiece and paint-by-numbers.

Section Four of The Qualitative Dissertation portrays six students' maneuverings along this same continuum. Interestingly, of the six interpretive exemplars, I most related to the  journeys of Jean and Joan, who each produced highly conceptualized, arts-based inquiries. While I am not doing anything so artsy (I am doing one of the more hum-drum qualitative genres out there!), I appreciated their struggles "to come to grips with the issue of genre" in the midst of doing their studies.


https://docs.google.com/presentation/d/1T9_KtfS6XvpnpLQtHRkv6TqwS8g7PCi3o8GlB8AFxgA/edit?usp=sharing

References
Piantanida, M., & Garman, N. B. (2009). The qualitative dissertation: A guide for students and faculty (2nd ed., Kindle version). Thousand Oaks, CA: Corwin.
Stake, R. E. (1995). The art of case study research. Thousand Oaks, CA: SAGE Publications.
Yin, R. K. (2008). Case study research: Design and methods (4th ed., Kindle version). Los Angeles: SAGE.

Share/Bookmark

February 7, 2013

659 project update, week of Feb. 4

I have been working on two aspects of my project over the last two weeks: conducting in-depth, unstructured interviews with literacy teachers and exploring the case study literature.

Interviews
Last night I completed another interactive interview/dialogue with a teacher from the reading specialist cohort that is the subject of my study. As I mentioned in my previous post, I have not been systematically reflecting on these unstructured interviews as they have been happening (four in the last two weeks, two face-to-face and two using Skype). I am at a point now where I am beginning to see connections and patterns, and, it's crucial I start documenting.

There are three levels of documentation I need to make: connections and patterns I am noticing across the content of the conversations themselves, ideas on how to improve the course experience for future reading specialist students (many of which can be implemented now, with the new cohort that just started the program), and my experiences with online interviewing. Unfortunately, all of my energy and attention seems bound up in ensuring a good online interview experience and quality recording. The participants have been positive and cooperative, but I am troubleshooting audio problems and getting poor sound quality, which is going to impinge on my transcription process.

In one failed interview attempt last week (this one using Collaborate -- the participant's preferred mode), the participant finally said she would prefer a face-to-face interview. So, I am now making plans to travel to her campus in a rural county, one hour northeast of Knoxville. (The technical difficulties with Collaborate had to do with a conflict between a Mac OS system update and Java, causing Collaborate not to launch properly. This conflict has been resolved.)

The case study literature
I have gathered texts by Yin and Stake as well as some miscellaneous articles and chapters on case study. I will be supplementing these with readings from Cresswell's Five Approaches. I began with Stake's The Art of Case Study Research, as this was recommended by one of my committee members. At some point before next week, I would like to balance out readings from Stake with some selected chapters from Yin's 4th Ed. of Case Study Research because this came highly recommended by another committee member.

My goal for the end of next week is to be able to say with some measure of confidence which of the two approaches -- Stake's or Yin's -- is the best one for an activity systems analysis, which is my ultimate purpose. In other words, I would like to build a logic-of-justification for a perspective on case study that aligns with my CHAT study. I know it's a backwards approach....

My initial impressions of Stake included some apprehension about his background in program evaluation, a perspective I thought would be ill-suited for the kind of work I do. I am encouraged, however, by his preference for instrumental case study work organized around issues, not  individuals per se. This aligns nicely with the tradition of case study within the literacy field, which has mostly been of the instrumental sort, according to Barone's (2011) historical review.

References
Barone, D. M. (2011). Case study research. In N. K. Duke & M. H. Mallette (Eds.), Literacy Research Methodologies (2nd ed., pp. 7–27). New York: The Guilford Press.
Stake, R. E. (1995). The art of case study research. Thousand Oaks, CA: SAGE Publications.
Yin, R. K. (2008). Case study research: Design and methods (4th ed.). Los Angeles: SAGE.

Share/Bookmark

January 30, 2013

On writing: train of thought, experiential text, problem statements, and lit reviews

This week’s readings from Piantanida and Garman’s (2009, Kindle edition) The Qualitative Dissertation: A Guide for Students and Faculty provided a jolt.  That brief moment of glory following the proposal defense is definitely over. It’s time to get back to work, and by “work,” I mainly mean writing. 


I have a love-hate relationship with writing. One of my favorite quotes about writing, variously attributed, goes something like this: “I hate to write. I love to have written.”

What follows are reflections and questions on past and future writing endeavors. I then conclude with ideas for my first project report for EP 659, due Feb. 14.

Writing (riding?) my train of thought
As I began reading chapters 9-12, a message from last week’s class stood foremost in my mind: THE ONLY THING YOU ARE GOING TO CHANGE WITH YOUR RESEARCH IS YOU. This resonates with Piantanida and Garman’s assertions about the "centrality of writing as a way of coming to know" (Ch. 9, “Experiential Text as a Content for Theorizing,” para 12). This is the nature of interpretive and practice-based dissertations, and I best get on board with it.

It’s not like I haven’t heard this stuff before. Piantanida and Garman remind me of things I’ve read recently (Kilbourn’s extremely helpful essay on crafting the qualitative proposal and Richardson’s classic, “Writing: A Method of Inquiry”) and things I have read not so recently, such as Welty’s One Writer’s Beginnings. I read that in high school!

When preparing my proposal earlier this winter, I found the Kilbourn piece to be especially comforting; Kilbourn provides explicit guidance on technical aspects that Piantanida and Garman do not. For instance, his description of the research problem as a gradually narrowing “train of thought” helped me considerably in writing my first chapter. Kilbourn’s advice on tackling the problem statement from a qualitative perspective is much more practical than Piantanida and Garman’s recommendation to abandon the problem statement altogether. (I will elaborate on this in a moment.)

Nonetheless, it’s there in Kilbourn too: the needling awareness that your train of thought runs on a short, messy track. Eventually you reach the end of the line, and “you have tvo construct the path you want to take” (pp. 569-570).  Kilbourn echoes Piantanida and Garman’s theme of deliberation when he writes, “Thus, the framing and wording of the proposal should reflect an attitude of genuine inquiry—it involves a spirit of genuinely finding out rather than proving" (p. 537).

Expressing the problem, defining the dilemma
In Chapter 11 Piantanida and Garman describe parts of the proposal. In acknowledgement of the fact that A) the proposal must be organized in a way that  supports the student’s line of reasoning and B) each institution has its own rules for format, the authors take extra care to avoid prescribing an order of the parts.

I experienced this quandary myself and was glad that my department’s PhD handbook allows flexibility in use of headings and sequencing. For instance, due to the number of technical terms related to my topic as well as the general “newness” of my frameworks to my field, I felt it was necessary to include a lengthy list of definitions fairly early in my first chapter. Also, for purposes of improved flow, I incorporated a thorough treatment on study significance after my Chapter 2 literature review. Kilbourn’s suggestions for “sign-posting” and “metawriting” gave me the confidence to try this (p. 563).

As I mentioned earlier, I found the whole discussion of problem statements to be…a problem. Piantanida and Garman recommend not having a "statement of the problem" because it is a holdover of positivist/scientifically framed studies. Then, they go on to describe how interpretive research is concerned with  "perplexing aspects" of "complex" human affairs -- in other words, problems. I don't think stating a "problem" necessarily carries the assumption that a solution exists. Qualitative researchers make it their business to "problematize" taken-for-granted situations, to make the ordinary problematic. So why not a problem statement? 

Or, better, what about the term "dilemma"? Maybe we should call it the "statement of the dilemma." For example, in my current project, the broad issue or topic under examination is teaching and learning with and through technology, which most reasonable stakeholders would agree is not a problem per se. But, it is inherently dilemmatic. Explaining what this means is the problem statement.

So, like the case of Marjorie (“Henny Penny” from Chapter 8), who “aimed to elucidate the nature of the dilemmas so that she could make more conscious and deliberate choices about her teaching practice" (Ch. 11, "Practice-Focused Dissertations," para 3), my goal is to problematize conventional thinking around instructional technology and teacher development, that is, the traditional view that problems in IT are often conceptualized as “gaps”(gaps in access and performance, gaps in discrete skills sets, and so on). However, as these concrete and discernable gaps are closed (with more computers, more networks, more training, etc.), new (and less transparent) inequities arise. Hutchison and Reinking (2011) surveyed literacy teachers across the country and confirmed that, while issues related to network access and technology support were largely becoming resolved, two distinct levels of use and integration existed in schools. They referred to these levels broadly as “technological integration” and “curricular integration,” with the former reflecting a lower-level, superficial stance toward technology as “add-on” (p. 314).

I return now to Piantanida and Garman, who jettison the problem statement entirely and replace it with something called a "statement of intent." But this, to me, sounds like the classic "purpose of the study" section? Don’t I need both a problem (a perplexing phenomenon) and a purpose (what I intend to do about it)? 

Crafting experiential text
As discussed last week in class, Piantanida and Garman’s concept of “experiential texts” equates to what we traditionally call the “findings.” The researcher must create "as textured and nuanced a 'picture' of the study context as possible” (Ch. 9, “Purpose of Experiential Text,” para 2). The process of writing experiential text, linking conceptual points, and constructing the core thesis is recursive and arduous.

Compared to the painstaking attention to detail that quantitative researchers apply to the design and execution of their studies, the rigor of qualitative studies lies in the crafting of  experiential texts. These texts must evoke an empathetic response in the reader. More importantly, they must evoke questions. The reader should question simplistic interpretations and taken-for-granted assumptions in the workaday world. The reader should ask, "What would I do in this situation?" This sets the stage for the theoretic text and the concepts that the researcher will offer as "a heuristic map" to guide "wise action” (Ch. 9, “Experiential Text as a Context for Theorizing,” para 7).

Piantanida and Garman use the term "iterative interpretation" for this process of bridging situational details (the raw data from the study context) to the conceptual issue being studied. This opens the door for "theoretic interpretation," which means drawing on formal discourses and concepts to make meaning of the situation.

This is an area of need in my academic writing. I am creating those bridges, but they are shaky. As my committee members pointed out to me, I have this undeniable tendency to end my paragraphs with a quote from the literature. Their advice is straight out of AP senior English class: I must take better care to couch other's words with my own interpretation and commentary. Ack! I used to teach this stuff. Why can't I do it?

For this reason, I found the last question in Reflective Interlude 9.1 to be relevant but challenging: What can I do to practice iterative and theoretic interpretation? Now that my consciousness has been raised, I am not sure how to proceed other than to revise the most offending passages in my proposal and then turn my sights on future writing efforts, such as my imminent plunge into the case study literature.

Reviewing the literature
The literature review is a “discursive text” that represents “the diversity of thinking associated with key concepts in one’s study” (Ch. 11, “Discursive text versus review of literature,” para 3). The literature review should also support one’s rationale for choosing a specific research genre/approach through construction of a “logic-of-justification.”

When too little time is spent with the literature, students encounter the pitfall of merely justifying qualitative inquiry against dominant positivist and postpositivist traditions. However, a well-written logic-of-justification does more than that. It justifies the qualitative inquiry against ongoing debates and discourses within its own traditions.

Like every other aspect of qualitative research, this process is disorienting and stress-inducing. Last fall, as I delved into readings on Cultural-Historical Activity Theory, I stumbled into “pockets of discourse where scholars are engrossed in discussions that one finds meaningful" (Ch. 11, “Preparing to construct a logic-of-justification,” para 3). I was in the middle of writing my frameworks when I discovered divergent opinions about CHAT between two leading theorists.

I had aligned myself with one theorist only to discover that another was making an equally compelling argument that seemed dismissive of the first guy. Did this mean I had to choose sides? I quickly sent off an email to one of my committee members whose methodological opinions I had come to rely on. She responded, “The issues you are dealing with do not have a right or wrong answer. It is an area that need cultivating, and you can join the conversation to do that.” Upon reflection, her reply now seems very much in alignment with Piantanida and Garman’s point of view (and Kilbourn’s).

And I am still not done constructing my logic-of-justification. In my readings on CHAT, I realized that, while drawn to design-based research (often used in CHAT studies), the opportunity to propose a design experiment had long since passed. It would be impossible for me to both follow this approach and meet the expectations of my committee chair, who also happened to be the lead instructor in the context under investigation (complicated!).

In my continued review of activity-theoretical studies, I learned that case study is another time-honored approach within the CHAT tradition. I am now poised to delve into that literature, but I am a little nervous. Although I have no reservations about CHAT as a coherent and compatible match to my own assumptions and research "proclivities," I have no idea how or if I can successfully locate myself within the case study tradition.

Will I find a reasonably strong and coherent link connecting the case study genre to my own "proclivities for making meaning"?  Will all my early data collection efforts, done without tether to a specific methodology, be in vain? Isn’t it too late for me to ask these questions?

I am hopeful that, as I explore the case study literature more deeply in the coming weeks, my process in comparing and interpreting them (Yin, Stake) will help me sort out some answers to these questions. I am also wondering if my documentation of this process (through writing) could serve as the bulk of my first project report for EP 659. 

References

Hutchison, A., & Reinking, D. (2011). Teachers’ perceptions of integrating information and communication technologies into literacy instruction: A national survey in the United States. Reading Research Quarterly, 46(4), 312–333.
Kilbourn, B. (2006). The qualitative doctoral dissertation proposal. The Teachers College Record, 108(4), 529–576.
Piantanida, M., & Garman, N. B. (2009). The qualitative dissertation: A guide for students and faculty (Second Edition, Kindle edition.). Thousand Oaks, CA: Corwin.

Share/Bookmark

January 23, 2013

Building your head

Section Two of Piantanida and Garman’s The Qualitative Dissertation (2009, Kindle edition) describes the conceptual work one must perform prior to conducting a qualitative research project.  A considerable amount of mental heavy-lifting precedes the more technical aspects of “doing” research.

If I actually knew anything about weight training and conditioning (or physical exercise in general, for that matter), I could get really carried away right now with metaphor. Suffice it to say, I felt pretty fit while reading some portions of Section Two and woefully out-of-shape while reading others.

I was reminded of the phrase “building your head” from H. L. Goodall’s (2000) Writing the New Ethnography (p. 51). Scholarship is a process of locating yourself in the “storyline” of your discipline.  It means reading widely and writing daily.  Piantanida and Garman would call it developing oneself as the “instrument of inquiry.” Whatever you call it, it’s a heavy workout.

Qualitative researchers must do this conceptual work if they want their research to be taken seriously and to resonate with their desired audience. As Piantanida and Garman explain, qualitative researchers approach topics and issues of inquiry with different assumptions and knowledge claims that don’t conform to prevailing positivist and postpositivist research paradigms. Our work is cut out for us.

Image by MR. LIGHTMAN, courtesy of freedigitalphotos.net 
The fundamental challenge of qualitative inquiry is answering the question: What is legitimate knowledge? According to Piantanida and Garman, “This question pushed qualitative researchers to articulate more clearly the nature of knowledge claims they were making” (Ch. 5, “Considerations of worldview,” para 5).

I wish I had known about this book last semester. The Reflective Interludes, particularly 5.1 and 7.1, provide terrific prompts for drafting the “Assumptions” section of a dissertation proposal. At any rate, I have identified some goals to work on – dare I say, “workout goals”? – for the coming semester:

Resist the “residue” of positivism and postpositivism
Piantanida and Garman refer to the “default language” of positivism and the fact that for so long quantitative research served as “a shorthand descriptor for a world-view embedded in the Western European ‘Enlightenment’” (Ch. 5, “Considerations of worldview,” para 4). Amen. I was 37 years old and at the tail-end of my master’s coursework before I even knew what qualitative research was! All in a tizzy, I did not think I could complete a master’s thesis without at least collecting some survey data and learning SAS. At that point, my adviser sat me down and explained that there were alternative methods that did not require an experimental design and a large n.

Over the last several semesters I have made concerted effort to curtail my use of words and phrases that suggest postpositivist assumptions. Two that come to mind are “achievement” (erroneously used as a synonym for “learning”) and “best practices” (falsely generalizing about instructional practice without respect for context and learner).

Yet, even as we come around to our own enlightenment, the language of the dominant paradigm is hard to resist. It just creeps up on you. Now, at the tail-end of my doctoral studies, I have had committee members scrutinize my word choice, calling into question seemingly benign words such as "factors" and "confirmed."

And, now, per Piantanida and Garman, I may need to more carefully consider use of the word “data.” That will be difficult!

I really do appreciate the distinction drawn in Chapter 8 between “data” and “text.” It jibes with my professional roots as an English/Language Arts teacher, trained in reader-response theory. Piantanida and Garman anticipate readers’ objections that the distinction borders on playing with semantics. They argue that representations of social phenomena, as opposed to representations of the physical world, “are always and inevitably interpretations offered by a particular person with a particular perspective and a particular position” (“From Data to Text,” para 4).

This is the essence of Louise Rosenblatt’s transactional theory of reading and writing, which views reader and text as inextricably bound in dynamic, mutually conditioning relationship. I cut my teeth on this stuff as a young preservice teacher! What’s not to love? I just wonder how forcing the distinction between “data” and “text” (much less forms of text – raw, experiential, discursive, and so on) might stall collaborative dialogue within one’s research community. It would certainly raise eyebrows among some dissertation committee members. 

Nonetheless, I am intrigued and would like to explore implications for more conscientious use of these terms in my own research journey.

Avoid simplistic dualisms
I understand that for the immediate task at hand – the dissertation – it is important for me to build a “conceptual frame” (Ch. 5, “Considerations of worldview,” para  17). As Piantanida and Garman recommend, “…[F]or purposes of conceptualizing a study, it is useful to sort out what form of knowledge claims one hopes to make by the end of the research process” (Ch. 5, “Considerations of worldview,” para 16).

This poses an interesting balancing act between being true to one’s core values, on the one hand, and acting pragmatically within the immediate research context, on the other.

What I struggle with is the possibility of being boxed in or branded by my conceptual frame, which, at present, is defined by a sociocultural perspective and a desire to seek insight and meaning rather than definitive proofs. I wonder if I limit myself by not seeking a more solid grounding in quantitative methods. Some of my colleagues are pursuing both research certificates, and, whether they are doing it for future job security in academe or because they see both paradigms as potentially valuable to their research agendas, I admire their hard work and ambition.

Piantanida and Garman seem somewhat dismissive of this pragmatic stance, but I like it, especially in the way it opens up potential for collaboration between camps. In my own readings on professional development and digital technologies, I see ways in which both kinds of research studies and knowledge claims can serve each other.

Maintain stance of "self as instrument"
I must see myself as the “instrument of inquiry,” all else is ancillary. This is the most crucial "workout routine" of all, and it is an especially difficult exercise for the teacher-researcher, coming from the culture of disempowerment that largely defines K-12 education. In the field of literacy especially, where decentralized decision-making, canned curricula, and scripted instruction prevail, thinking, planning, and acting instrumentally can be unfamiliar territory.

In the Chapter 6 section on voice and stance, I was struck by how the different researcher stances paralleled certain teacher dispositions. The researcher’s worldview affects her subject-object orientation with regard to participants. Similarly, a teacher’s worldview dictates how she regards her students. Are they subjects in or objects of her instructional design? The third stance described in this section, in which the researcher risks challenging her own certitude and self-understanding, is, in fact, what teacher development expert Gerald Duffy (1998) has called the “thoughtful adaptation” of effective teachers (p. 778).

This process of “thinking through one’s relationship with that which is under study” (Ch. 6, “Stance and voice,” para 1) reinforces Piantanida and Garman’s earlier assertion that the dissertation is an orientation to a life of scholarly inquiry. It is as much an opportunity for personal development as it is an obstacle to surmount in the quest for professional advancement. It is the “thinking through” that stimulates “a reforging of one’s ontological stance,” leading to new understanding (“phronesis”). This is the ultimate goal of qualitative research: to share these new understandings in hopes that others may recognize "new possibilities for their way of being in practice.” 

Does that not fulfill the “legitimate knowledge” requirement?

References
Duffy, G. G. (1998). Teaching and the balancing of round stones. Phi Delta Kappan, 79(10), 777–80.
Piantanida, M., & Garman, N. B. (2009). The qualitative dissertation: A guide for students and faculty (Second Edition, Kindle edition.). Thousand Oaks, CA: Corwin.


Share/Bookmark

January 14, 2013

Qualitative research, wicked problems, and the teacher-learner

This past week, as I began reading Piantanida and Garman's (2009, Kindle edition) The Qualitative Dissertation: A Guide for Students and Faculty, it occurred to me that qualitative research is akin to a "wicked problem."   

The "wicked problem" truism originated from a 1973 essay by Rittell and Webber, titled "Dilemmas in a General Theory of Planning." The authors describe the impact of pluralism and postmodernism on skilled professionals (teachers, academics, policymakers, city planners, and so on). Societal challenges once deemed simple, e.g. the formulation of school curricula, had evolved such that "professionalized cognitive and occupational styles that were refined in the first half of the century" were no longer adequate for addressing them (p. 156). 

I first encountered the concept of "wicked problems" in the instructional technology literature, in which researchers refer to the wicked problem of teaching with digital tools. Teaching, an already complex activity, is made more unpredictable by pressure to integrate continually evolving and "protean" technologies (Koehler & Mishra, 2008). Moreover, the recent influx of digital and mobile technologies into society arrived on the heels of another sweeping societal trend: the school reform movement and its demands for domain mastery and content area expertise. 

The convergence of these trends imposes a significant dilemma for teachers. One begs for structure, accountability, and standardization of practice; the other requires "flexible and integrated bases of knowledge" (Koehler & Mishra, 2008, p. 3). One defines expertise as a matter of curriculum implementation; the other views expertise as a matter of design, teacher as both designer and student of the curriculum. Wicked problems, indeed.

Recognizing qualitative research as wicked problem
Wicked problems are ill-defined and require an entirely new orientation to work/job performance, goal formulation, and one's own self-understanding as a competent expert. "This is partly because the classical paradigm of science and engineering -- the paradigm that has underlain modern professionalism -- is not applicable to the problems of open societal systems" (Rittell & Webber, p. 160). I initially interpreted this as a profound mandate in favor of qualitative research.

And yet, according to Piantanida and Garman, the study and conduct of qualitative research itself suggests another wicked problem! 

Piantanida and Garman characterize qualitative research as an ill-defined and complex domain, encompassing a variety of ideas, definitions, methods, and strategies. "Tremendous amounts of time, energy, and money can be consumed in a fruitless quest for a straightforward explanation of a complex field of study," they warn (Ch. 2, "Variations in deliberative inclination," para 1). 

Photo by adamr, courtesy of freedigitalphotos.net
How many of us have the bowed bookshelves and bulging Amazon balances to back up that claim?

Further, doing qualitative research is especially difficult for the aspiring teacher-researcher, whose workaday world is framed by innumerable top-down mandates and externally imposed performance standards. When teachers return to graduate school, they may be taken aback by the expectation of self-learning and introspection associated with writing a dissertation, much less a qualitative one. They may experience frustration when they discover there is no "recipe, formula, or template" to address their "action-oriented concerns" (Piantanida & Garman, Preface, para 5). 

Becoming a teacher-learner
Lovitts (2005) describes the "critical transition" that graduate students make between completing coursework requirements and embarking on independent research projects. At some point, the graduate student must move beyond the role of knowledge greeter/consumer to knowledge seeker/producer. In this process, the attainment of discrete knowledge and skills is less important than the student's ability to leverage a variety of "personal and social resources" (p. 140). According to Lovitts, these "variables" are poorly understood due to "the educational system's over-valuation of analytical intelligence and other norms in graduate education that promote intellectual conformity" (p. 151).

This should come as no surprise to anyone acquainted with the U.S. educational system. Schools in general (and the researchers who study them) put a premium on cognition at the expense of creativity, sociability, and other "idiosyncratic" processes. Why would it be any different for students at the highest levels of academe? This over-emphasis on accountability to predefined standards of excellence creates, at best, throngs of "good course-takers" and, at worst, murderous rampages, such as the one Lovitts describes at the beginning of her article.

Enter the teacher-as-student. According to Piantanida and Garman, the critical transition is unsettling for K-12 teachers, long socialized as consumers and disseminators of knowledge. The teacher's transition ironically may be hindered rather than helped by his or her years of practical classroom experience. This is the problem of "encapsulation," in which classroom teachers, who have come into their own as professionals within contexts that prize efficiency, conformity, and certainty, must re-orientate to the "false starts," "blind alleys," and "failures" of scholarly inquiry (Ch. 2, "On the discursive nature of deliberation," para 3). 

It's inherently dilemmatic that to become a better teacher (that is, to advance oneself professionally by seeking additional degrees and certifications) one must stop thinking like a teacher!

Piantanida and Garman define the encapsulated mindset as "the self lost in the tension between the professional role and the student role that manifests in a form of estrangement and keeps one from a deliberative frame of mind" (Ch. 2, "Encapsulation versus deliberation," para 3). I recognize this tendency in myself, recalling my struggle over the last several semesters to find value in certain methodologies I viewed as too esoteric (conversation analysis) or two time-intensive (ethnography) to have any practical significance for my desired research context and participants (secondary literacy teachers and their students). 

Developing creativity, or a "deliberative mode of learning"
In their preface, Piantanida and Garman hint at the problem of encapsulation and recast it as an opportunity, suggesting that the novice teacher-scholar leverage the tensions and use "practical issues to surface issues of worldview and issues of worldview to inform the decisions associated with crafting and conducting a qualitative dissertation." 

The dissertation, then, is not a procedural hoop, not just a means to an end. Insofar as it nurtures "a scholarly stance in practitioners," the dissertation is an end in itself. 

Thus, the qualitative dissertation is an excellent orientation to a life of scholarly inquiry and "deliberation." The novice researcher becomes versed in the literature and discourses of his or her discipline, enabling a creative cross-pollination of ideas to occur with respect "to intellectual roots and traditions" (Piantanida & Garman, Ch. 1, "Entering into the study of qualitative research," para 9). Piantanida and Garman's "deliberative mode of learning" is the route to developing creativity, a topic that figures prominently in the Lovitts article.

Lovitts upholds creativity as "inherent in and integral to graduate education" (p. 140). Creativity "exists in degrees" and is not "an all or none phenomenon" (p. 141). As a society we value cognitive performance because it is easy to measure against predefined norms and expectations, but it is our capacity for "creative performance" (p. 151) that will ultimately determine the quality of our scholarship and our ability to tackle society's greatest challenges -- "wicked problems," such as education reform. 

Lovitts presents a hopeful view of creativity as sociocultural phenomenon.  Unlike conventional notions of talent and intellect, creativity is not something we are born with but is the result of sustained interaction between an individual and his or her disciplinary field. As such, "it may be possible to enhance the individual's creative performance through appropriate interactions with the domain and the field" (p. 142). Likewise, Piantanida and Garman implore the teacher-learner to engage with the broader discourse community of their discipline: "Preliminary ideas grounded in personal experience undergo revision and refinement as one reviews formal bodies of literature" (Ch. 2, "On the discursive nature of deliberation," para 3).

Further, because the creative experience is so variable, it cannot be evaluated or measured but "should be judged relative to the student's capabilities and not a universal standard" (Lovitts, p. 142). Based on these assertions, Lovitts concludes with a number of implications for changing the "social structure and organizational culture of graduate education" (p. 151).

Lovitts focuses mostly on the influence of "micro-" and "macroenvironments" on the graduate student experience. Piantanida and Garman, on the other hand, acknowledge the shortcomings of higher education contexts but focus their advice squarely on students themselves, who must develop a deliberative stance in light of (in spite of?) the fact that "formal graduate programs and courses in the United States are not organized so that students can be independent learners" (Ch. 2, "Encapsulation versus deliberation," para 5).

"Sloshing" around wicked problems
As much as I like the illustration of "steps to graduation," there really are no neat and tidy checklists or rubrics by which to gauge one's progress. The process is messy, much like Piantanida and Garman's metaphor of sloshing through puddles. Qualitative inquiry, after all, is no “tame” problem, for which “ an exhaustive formulation can be stated containing all the information the problem-solver needs for understanding” (Rittell & Webber, p. 161).

Qualitative research is wicked. It demands “conceptual grappling” (Piantanida & Garman, Ch. 4, last para).

This grappling can take place within "think pieces," a mode of writing somewhere between a personal journal entry and formal, polished academic writing. Blog entries (such as this) or reflective memos can serve this purpose. (I myself have come to rely on the format and coding of memos that Richardson describes in the 1994 version of her essay "Writing a Method of Inquiry.") 

It seems to me that the production of think pieces (or, simply put, writing) is part and parcel to pacing and shaping the dissertation, which Piantanida and Garman take up in chapters 3 and 4, respectively. These issues have certainly weighed heavily on my mind in recent semesters, when it seemed I would never "find" a topic. 

On the subject of pacing, Piantanida and Garman say it "depends less on what one is doing than on what one is coming to understand. Forward movement occurs as the conceptual structure and content of the inquiry become increasingly clear and coherent” ("Staying the course of the dissertation," para 3). 

Similarly “shaping” a dissertation topic is not an outward search but a matter of fashioning “nebulous, inner images” into “credible and worthy studies” (Ch. 4, “Deliberations on topic,” para 2), also suggestive of the writing process. The willingness of the teacher-researcher to engage in the messines and to resist traditionally linear problem-solution formulations, is the hallmark of Piantanida and Garman’s deliberative stance.

References
Koehler, M. J., & Mishra, P. (2008). Introducing TPCK. In AACTE Committee on Innovation and Technology (Ed.), Handbook of Technological Pedagogical Content Knowledge (TPCK) for Educators (pp. 3–29). New York: Routledge.
 Lovitts, B. E. (2005). Being a good course-taker is not enough: A theoretical perspective on the transition to independent research. Studies in Higher Education, 30(2), 137–154.
 Piantanida, M., & Garman, N. B. (2009). The qualitative dissertation: A guide for students and faculty (Second Edition, Kindle edition.). Thousand Oaks, CA: Corwin.
 Richardson, L. (1994). Writing: A method of inquiry. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of Qualitative Research (pp. 516–529). Thousand Oaks, CA: SAGE Publications, Inc.
 Rittel, H. W. J., & Webber, M. M. (1973). Dilemmas in a general theory of planning. Policy Sciences, 4(2), 155–169.

Share/Bookmark

September 7, 2012

Low-tech student response system

These past few weeks, I have been preparing the guestroom/spare bedroom as a home office space, the quintessential "room of one's own" for this, my final year -- I hope! -- of the PhD marathon. (Note: I did not say final year of education. That will never end.)

In the process, I have been going through boxes from my teaching days and purging things I could not bear to part with when I left the classroom in 2005.

This time around, some stuff was easier to let go of, such as the crate of office supplies that no longer fit my paperless lifestyle. I hope the ladies at the church rummage sale find a good home for all those notebooks, dividers, and packages of loose-leaf paper.

But other items proved more difficult to dispose of, perhaps because they represent my past life as a classroom teacher in ways that a generic, 3-ring binder never could.

For instance, I located a box of multiple choice "flip-cards" and a set of laminated pinch cards that contain some of the more challenging homophones from our local 9th grade English end-of-course test.

Students used the flip-cards or pinch cards to indicate their answers to sample test questions that I read aloud during whole group instruction. A sort of kinesthetic twist on (yes) the very worst form of call-and-respond, teacher-centered instruction.

These "relics" are less than ten years old, but in these days of automated digital response systems, I was struck by the elegant ingenuity that inspired these homemade tools for active learning and student engagement (inspiration I completely stole, mind you, from another teacher somewhere along the way).

Although these low-tech precursors to modern-day clicker technology were used to prep students for the oppressive onslaught of AYP testing, they also remind me of how teachers improvise and innovate to make time in the classroom (a little?) fun. And when you think about it, the flip-cards and pinch cards and clickers and text-message polls do what the mass-administered, standardized tests will never be able to do: they support real-time, classroom-level assessment with instantaneous feedback to the learner.

So, I am keeping these handmade artifacts, if for no other reason than to remind me of those fast and furious days of NCLB test-prep. And, besides, no one would buy them at the church rummage sale.
Share/Bookmark