Thursday, November 14, 2013

UT Teacher Evaluation Proof


Proof of semester evaluation.  As a parent opting her son out of participating in the teacher evaluation  being utilized in his school, I am opposed to submitting these for my professors as well. However, all of you have been asking for us to complete them.  Enjoy!

Atlas.ti Experience, Other Learning, and Plans for Intersession

Thanks for a great semester.  I know that it doesn’t seem like it sometimes, but I have learned a lot.  At this point in my learning and after Dr. Huth’s visit tonight, I think that I enjoy CA more, but I still have a lot of learning to do.  I loved his visit.  It was very informative and he is a great speaker.  What courses does he teach here at UT?  I believe he mentioned that he is in the foreign language department and German.  Is there anything else that he teaches?

Before you read about my experience with Atlas.ti, remember its not you, its meJ

As for Atlas.ti, I will concede that the more that I learn about the program, the easier it is to work with.  At the beginning of the semester, it was a VERY HORRIBLE transition to make.  I tried several different methods for becoming an Atlas.ti user.  I am a MAC user and the learning curve for the new PC programs is horrible.  I know that you don’t recommend it, but I was told that Parallels would allow me to run Atlas.ti on my Mac until the software is available for Mac products.  My husband bought me a new MacBook during tax-free weekend and Parallels, but Microsoft has been out (not selling the version) of the Windows product that I need to make Atlas.ti work on my laptop.  That was frustrating. 

When Parallels wasn’t an option for me, I checked out one of the netbooks that you reserved for our class. When it was returned by the previous user, the netbook wasn’t wiped clean and it loaded a TON of files to my DropBox account. That added stress to my semester, because I was SCARED TO DEATH that I deleted somebody’s work that was needed for their dissertation.  I know that is why we have back-up copies of everything, but I felt really bad.  I just freaked out when I saw the strange files and deleted before I thought. Another problem with the netbook that I had was that every program on it was a trial version, so each time I tried to do something it was expired and it had to be activated.  I returned the Netbook and started using an old laptop that my husband has, but it isn’t compatible with my new Mac program for Office products. 

All of that previous discourse (smiles) was just to point out the difficulty/frustration that requiring one program can cause. Not only did I have to learn the PC side of things and basically set up a program on two different computers, but I had to learn Atlas.ti. Thanks to my literacy education friends and YouTube videos, I have learned the basics. I STILL HAVE TO LEARN A LOT ABOUT ATLAS.TI, because I have only touched the surface with this program, which is to say that I know nothing.  Another problem that I had was that the method that I had for recording my data was an app on the iPhone and the iPad.  Before recording, I made sure that the program would be able to save in a format consistent with DropBox and with Atlas.ti.  However, it wouldn’t allow me to submit any audio file over 25 minutes.  They might’ve gone into DropBox, but Atlas.ti wouldn’t recognize the file.  Therefore, the conversational data that was used for this assignment wasn’t my first, second, or third pick for the assignment. The point to this rant is just to say that a lot of the time that could have been devoted to reading more of the recommended texts for learning more about DA was taken up by my efforts to try and learn Atlas.ti.   I still have no idea why you use the different components of Atlas.ti (i.e., what purpose they are used for).

I still have access to the shared files from my semester in Digital Tools with you.  During the intersession, my plan is to read through the notes from our class regarding Atlas.ti, Ann’s Atlas.ti PP, Hollie’s Skillbuilder on Atlas.ti from her Digital Tools class with you, and read through the training manual on the Atlas.ti website in preparation for the Spring semester.  My husband is going to buy me a Netbook for the purposes of Advanced Qualitative Research in the spring, so that I can learn to use and learn one computer for that class.  I am going to spend time practicing Atlas.ti and getting the computer ready for the semester.  Also, since you mentioned that we will pick an area/method of qualitative research to investigate deeply as individuals in Advanced Qualitative Research in the spring, I am going to spend up on either Case Study, Phenomenology, Narrative Analysis, and/or Ethics of Online Data.  If you think one is more preferable than the other, please let me know so that no time is wasted.





Sunday, November 10, 2013

Final Blog:-( or ;-)

In a word, Discourse Analysis means Doing Analysis. (Antaki et al., 2003)

I think that the overall arching connection between these readings was that qualitative research is equivalent in its own right to quantitative research, but that a problem that comes up in this line of work is that the researcher doesn’t pay it the respect that it deserves.  The research isn’t always done accurately, the analysis is sloppy, or time hasn’t been devoted to developing the craft as they should have.  Researchers need to spend time learning about what an interview is and isn’t.  They need to recognize how to really do the analysis, so that it is conducted and verified by the data itself, such as being followed up in the next turn.  This isn’t easy work and if done correctly, provides everything that quantitative researchers are looking for, i.e., validity, without all of those messy numbers. 

In terms of the Golato article, I found the concept of DCTs interesting, but I was left with that feeling of ‘Duh!’  Humans are infallible.  They are different.  No interaction can ever truly be replicated, because nothing can ever been the same in a subsequent interaction.  For example, I am sitting on my couch typing this paper and my husband has been researching vacation destination for us for winter break.  He was excited about taking me on a beach vacation, because he knows how much I love the beach.  When he got my deflated reaction about the possible cold weather in late December, he went back to looking.  From this point forward, every vacation option he encounters that involves a North American beach will be viewed differently than before.  Our interaction changed his perception.  If he or someone else tried to replicate our interaction, they would approach it with a different stance. 

Golato talked about the function of a compliment in a classroom and non-institutional setting and it made me think about a southern term that we have blogged about before, ‘Bless your heart.’  Anywhere in America that saying would appear to be a sympathetic statement, but in the south, it probably means the speaker thinks that the intended is an idiot.  Context matters.  Background knowledge matters.  This also made me think of Peter Johnston’s Choice Words or Opening Minds.  The simplest of phrases can be interpreted in a number of ways based on the context in which they are said or based on the tone of voice or the mood that the participants are in. 

Potter, J. & Hepburn, A.  (2011).  Eight challenges for interview researchers.  For J.F. Gubrium and J.A. Holstein (Eds) (forthcoming).  Handbook of Interview Research (2nd Ed.). London: Sage.

The irony is that qualitative interviews are massively overused, but their potential has been massively restricted.

Our aim in this chapter is to make the case that interviewing has been too easy, too obvious, too little studied and too open to providing a convenient launch pad for poor research…faces up to a series of 8 challenges.
Set 1 (reporting to the interview study):
1)   improving the transparency of the interview set-up (how participants are recruited);
2)   more fully displaying the active role of the interviewer (interview is interactional, but not followed through in research practice);
3)   using representational forms that show the interactional production of interviews;
4)   tying analytic observations to specific interview elements.

Set 2 (analysis of the interview):
5)   how interviews are flooded with social science categories, assumptions and research agenda;
6)   the varying footing of interviewer and interviewee;
7)   the orientations to stake and interest on the part of the interviewer and interviewee;
8)   the way cognitive, individualist assumptions about human actors are presupposed.

Golato, A. (2003).  Studying compliment responses: A comparison of DCTs and recordings of naturally occurring talk. Applied Linguistics, 24(1), 90-121.

Golato argues that ‘recording naturally occurring talk-in-interaction enables the researcher to study how language is organized and realized in natural settings (pg. 90.’

Comparative studies (e.g. Yuan 2001) of role plays and naturally occurring conversations have indeed shown that what is said and, more importantly, how it is said differ drastically in role plays and in actual conversations (pg. 94).

Study of classroom compliments versus non-classroom compliments…’One cannot assume that compliment serve identical functions and have the same design in ordinary and institutional talk (pg. 96).’

Goodman, S. (2008).  The generalizability of discursive research. Qualitative research in psychology, 5, 265-275.

‘I show how such findings (discourse analytic findings) can be considered generalizable to the extent that they can show how a particular discursive strategy will often bring about the same interactional results (pg. 265).’

-quantitative vs. qualitative comparison and definition of generalizability: ‘The process of making statements about the general population on the basis of relevant research (e.g., experiments or surveys).’ (pg. 265)

Qualitative researchers tend to accept that their findings cannot be generalized in this way: instead generalizability is sacrificed in favor of a more detailed understanding of the issue being researched (pg. 266).

Guba (1981):  qualitative researchers could replace this with what he called transferability where findings within one context can be applied to another if there is sufficient knowledge of the contexts in question (pg. 266).

To Edwards and Potter, social action refers to the interactional accomplishment that a piece of discourse brings about.  This may be, for example, the action of remembering, blaming, performing prejudice, or any other outcome of social interaction (pg. 267).

To conclude, where it has been widely accepted that discursive psychological findings are not generalizable, I have shown that a discursive strategy can be generalizable to the extent that the ‘action’ that it accomplishes can be generalized across contexts (pg. 273).

Antaki, C., Billig, M., Edwards, D. & Potter, J. (2003).  “Discourse analysis means doing analysis: A critique of six analytic shortcomings.” Discourse Analysis Online, 1. Available from: <http://www.shu.ac.uk/daol/articles/v1/n1/a1/antaki2002002-paper.html>.

‘Discourse analysis still can be misunderstood by those who have been schooled in quantitative analysis.  It might appear to quantitative researchers that ‘anything goes’ in qualitative work in general, and discourse analysis in particular.’
-Problems: researchers self-education, work produced embodies basic problems

“Writers are not doing analysis if they summarize, it they take sides, it they parade quotes, or if they simply spot in their data features of talk or text that are already well-known.  Nor are they doing analysis if their discovery of discourses, or mental constructs, is circular, or if they unconsciously treat their findings as surveys.”

‘It is safe to say that analysis means a close engagement with one’s text or transcripts, and the illumination of their meaning and significance through insightful and technically sophisticated work.  In a word, Discourse Analysis means Doing Analysis.

Golato Notes…
-purport actual language use: the forms and formats of a compliment response, the comparison of compliment responses in different languages (pg. 91)
-‘My results suggest caution in using DCTs if one’s goal is to describe actual language use (pg. 91).
-administrative advantages of DCTs…researchers can better control variables, quickly gather large amounts of data without transcription, better ability to compare native and non-native speakers (pg. 92)

Goodman Notes…
Definitions:
-Validity: showing what it is claiming to show
-Construct Validity: show that the effect demonstrated can be generalized from the measures used in the study to the fuller construct
-External Validity: being able to generalize the research findings to the population in general
-Ecological Validity: the extent to which the research findings can be generalized to other settings
-Population Validity: the extent to which the research findings from the sample studied to the wider population
-Reliability: the extent to which a given finding will be consistently reproduced where it is deemed that similar results will be consistently found from the same research study (pg. 265-266)
-best known example of a generalizable conversational strategy is that of the three-part list, where lists are consistently seen to include three items to show that the list is complete, and that what is been described is normative (pg. 268)

The analyst should be able to state that the following is true in order to make a claim of generalizability:
1)   A discursive strategy can be shown to achieve a certain rhetorical accomplishment.
2)   This strategy can be identified as being used in a range of conversational settings in an attempt to bring about this rhetorical accomplishment.
3)   If this strategy often brings about the same accomplishment this strategy can be described as a successful strategy.
4)   It can be shown that successful strategies will be used by a range of speakers in a range of contexts to bring about the same rhetorical end.  To this extent, it is a generalizable example of an action performed by a rhetorical strategy.
5)   We may eventually begin to see opposition to successful and generally used strategies (pg. 272).

Antaki et al…
Qualitative/Quantitative: Both want to do something with the data.  Neither is content merely to lay the data out flat.

Transcription prepares the data for analysis.  However, it is not the analysis itself.

Hutchby & Wooffit Revisited…

The most central of these assumptions is that ordinary talk is a highly organized, socially ordered phenomenon (pg. 11).

At the most basic level, conversation analysis is the study of talk.  It is the systematic analysis of the talk produced in everyday situations of human interaction, talk-in-interaction (pg. 11).

One aim of CA therefore is to reveal this sequential order...describable ways in which turns are linked together into definite sequences (pg.42).

The next-turn is the place where speakers display their understanding of the prior turn’s possible completion. The next speaker has performed on the typed of utterance the prior speaker has produced (pg.42).

‘Paired Action Sequences that conventionally come in pairs:  questions-answers, greetings-return greetings, invitations-acceptance/declinations (pg.42)

The format for agreements is labeled the ‘preferred’ action turn shape and the disagreement format is called the ‘dispreferred’ action turn shape (pg. 46).

‘dispreference markers’: turns that is some way depart from what seems to be expected incorporate a variety of these, ‘well’ or ‘um’ (pg. 47)

Preferred actions are characteristically performed straightforward and without delay, while dispreferred actions are delayed, qualified and accounted for.  The concept refers to these structural features of turn-design and not to individual motivations or psychological dispositions (pg. 47).

Organization of Turn-Taking:
1)   turn-taking has occurs
2)   one speaker tends to talk at a time
3)   turns are taken with as little gap or overlap between them as possible (pg. 49.

Overlapping talk may be considered evidence of an incoming speaker’s failure to take notice of whether the current speaker is or is not finished (pg. 54).

Four varieties of repair sequences:
1)   Self-initiated self-repair: repair is both initiated and carried out by the speaker of the trouble source.
2)   Other-initiated self-repair: Repair is carried out by speaker of the trouble source but initiated by the recipient.
3)   Self-initiated other-repair: The speaker of a trouble source may try and get the recipient to repair the trouble—for instance if a name is proving troublesome to remember.
4)   Other-initiated other-repair: The recipient of a trouble-source turn both initiates and carries out the repair.  This is closest to what is conventionally understood as ‘correction’ (pg. 60).

The first two places in which repair can occur are within, or immediately after, the turn construction unit containing the trouble source (pg. 62).

The second place in which repair can be done occurs immediately at the next transition relevance place after the trouble source (pg. 63).

CA also focuses on:
Gaps and pauses
Breathiness

Talk in Institutional Settings

Turn-type pre-allocation means that participants are normatively constrained in the types of turns they may make according to their particular institutional roles. Typically, the format involves chains of question-answer sequences, in which the institutional figures ask the questions and the witness, pupil, or interviewee is expected to provide the answers.  This format is oriented to by participants, but at the same time normative rules operate which mean that participants can be sanctioned if they refuse to stay within the boundaries of the question-answer framework (pg. 141).

A three-part list is simply a way of packaging a point or position in an argument using a list of three separate items (pg. 183). 

A contrastive device is means of packaging a point, where one argument or approach is contrasted with another in such a way that the speaker’s favoured position is seen to be superior (pg. 183).


While CA aims to describe the ways that participants display that they are aware of specific contextual factors (by observably modifying the ways that they talk, for instance), CDA maintains that there are other factors, external to the situation the speakers are in, and of which the speakers may not be aware, that impact on the production of their talk (pg. 210).

Wednesday, November 6, 2013

CMC Research...Blogs

This was one of the topics that we read in DP and I have to say that I had a new perspective when I was reading it this time based on my personal research interests.  I understand that for the purposes of this study that you were working with students and that IRB was used to explain that the students grades were not contingent upon participation in the research project, etc.  What other considerations were taken to protect the students/participants and the researcher/instructor?  I am now interested in conducting research using social media sites for my research, such as Facebook, Twitter, blogs, etc.  It's not my desire to use this for my entire dissertation, but I am interested in having it as a piece of my data.  We've 'talked' previously about one of the issues with using FB posts as data is that participants login with a password and there is the question/issue of privacy in a public domain.  You mentioned that a difficulty that I might run across is the participants who don't sign consent.  Would I not be able to use any data from a page if one person didn't consent?  What if I started my own FB page on the subject and put a disclaimer on the page as one measure?

I had my first experience moderating a class on BB this past weekend and it made me think of your study.  There were different levels of participation from the more 'peacock-ing' students to the 'Well I better work at participation point' students to 'I wonder if the professor even knows I'm here' slugs.  It also made me think of my experience in Digital Tools with the classes we had via BB or Skype.  It was awkward and I know how that hindered by participation (along with confidence issues).

Accountability and displays of knowing in an undergraduate computer-mediated communication context (Lester & Paulus, 2011)

In this study, we draw upon elements of discursive psychology as we oriented to what was happening in the talk from the participants’ perspective in addition to what should be happening from the researcher/instructor perspective (1).

Our findings point to how students negotiate and at times resist doing being a knowledgeable student, using disclaimers, such as ‘I don’t know’ and script formulations to minimize accountability for their posts (1).

Activating prior student knowledge on a topic and encouraging reflection on new information are strategies that have long been considered useful for learning (Dewey, 1933).

A great deal of research has examined CMC discussions in educational environments, most notably asynchronous discussion forums, for evidence of learning, evidence of argumentation, collaborative knowledge building, and cognitive presence (2).

Friesen and Hug…suggest that researchers attempt to orient to the participant perspective of the discussions rather than the researcher’s perspective alone, shifting their focus from what should be happening (e.g. particular argumentation structures) in these environments to what is happening.  As Stokoe (2000) points out, there’s a long history of attempting to categorize, classify, and evaluate different kinds of classroom talk, yet’…good or successful educational discourse is’ an ‘abstract notion’ and often quite difficult to determine (p. 186).

DP assumes that ‘psychological phenomena can be investigated without seeking to fix their causal origin in a hidden and speculative mental of cognitive domain as conversational contributions and interactions are shown to possess a startling complexity and an explanatory self-sufficiency’ (Friesen, 2009:143).

‘knowing’ is understood as bound up and embedded within interactions, with language being understood as constitutive (3).

This study looks at undergraduate blogging conversations in the context of an introductory nutrition science course (3).
-situated within DP, which draws upon discourse analysis, ethnomethodology, conversational analysis, and rhetorical psychology (4)
-focus on three broad themes from DAM: 1) action, 2) fact and interest, and 3) accountability (Edwards and Potter, 1993; Potter et al., 1993)
-approached data through 1)repeated readings; 2) selection organization, and identification of patterns, 3) generation of explanations; 4) noting variability and 5) reflexive and transparent documentation of our claims (4-5)

The purpose of this task was to provide an opportunity for students to 1) activate their prior knowledge on the topic of dietary supplements, 2) engage and interact with their peers, and 3) reflect on what they had learned. We assumed students may be motivated to post in the online blogging environment as they completed the task (4).

Publicly displaying knowledge is not an easy request for students (10). 

Students used discursive resources to downplay their personal accountability for the task (11).

Arminen (2005) discussed five basic patterns of classroom talk: lecturing format, pedagogic cycle, repair sequences, correctional activities and organized extra-curricular activities (11). 

Making learning ordinary: ways undergraduates display learning in a CMC task (Paulus & Lester, 2013)

The pedagogic cycle, also known as the initiate-respond-evaluate/feedback pattern involves students being asked a question to which they respond and subsequently receive an evaluation by the instructor.  This pattern can be used to maintain order and control in face-to-face classrooms where one authority figure is responsible for numerous students (54).

A DP perspective orients to psychological constructs, such as cognition and learning, as ‘objects in and for interaction’ (Potter, 2005: 789), and assumes that they are situated in and made visible through discursive practices (55).

By shifting the spotlight away from students’ private minds we, as analysts, instead ‘approach discourse (learning) as a social practice rather than mental expression’ (Edwards, 1999, 288).

For the purposes of this study, we were interested in exploring the construct of learning as a situated practice within the context of a CMC task designed to elicit learning displays from undergraduate students (55).

Sacks (1984) describe how people go about doing “being ordinary” in everyday life and will work to normalize any unusual or extraordinary occurrences.  Sacks argued that we go to great lengths to present our experiences in accepted, normal ways.  Asking students to write about (or verbally report) what they have learned is asking them to make public the ways in which they may be different from their peers, or to orient to something as not ordinary, rather than ordinary (56).

An extensive set of CMC data generated at a research university in the southeastern region of the United States (with IRB approval)
-undergraduates in large nutrition course
-required blogs

During this first step of analysis, we met regularly to read each post out loud, recording our individual and joint reflections about those sections within each post that we initially found most intriguing (Potter and Wetherell, 1987).

As we re-read, the following broad, discourse analytic questions sensitized our analytic process (Potter, 2004):
1.     What are the students accomplishing with their posts?
2.     How are they constructing their blog posts in order to achieve this?
3.     What discursive practices are being used to perform these tasks? (58)

Findings:
-learning as an extreme change of state (I was amazed)
-learning as a neutral assessment of news
-learning as denying a change of state

Arminen (2005) argued that a major institutional purpose of primary and secondary schooling is to develop the ability to react to new information (often presented through lectures) in a neutral manner rather than according to one’s personal experiences or preferences.  He suggested that it is instructor assessment and feedback via the pedagogic cycle that maintains student engagement in the absence of connections with personal experience (64-65).


As educators we should acknowledge that engaging in CMC conversations can be a delicate matter for students, and the more delicate the matter, the more attention needs to be given to preparing students to manage dilemmas presented by the tasks in ways that do not directly conflict with the pedagogical outcomes of such tasks (66).