Thursday, November 14, 2013
UT Teacher Evaluation Proof
Proof of semester evaluation. As a parent opting her son out of participating in the teacher evaluation being utilized in his school, I am opposed to submitting these for my professors as well. However, all of you have been asking for us to complete them. Enjoy!
Atlas.ti Experience, Other Learning, and Plans for Intersession
Thanks for a great semester.
I know that it doesn’t seem like it sometimes, but I have learned a
lot. At this point in my learning and
after Dr. Huth’s visit tonight, I think that I enjoy CA more, but I still have
a lot of learning to do. I loved his
visit. It was very informative and he is
a great speaker. What courses does he
teach here at UT? I believe he mentioned
that he is in the foreign language department and German. Is there anything else that he teaches?
Before you read about my experience with Atlas.ti, remember
its not you, its meJ
As for Atlas.ti, I will concede that the more that I learn
about the program, the easier it is to work with. At the beginning of the semester, it was a
VERY HORRIBLE transition to make. I
tried several different methods for becoming an Atlas.ti user. I am a MAC user and the learning curve for
the new PC programs is horrible. I know
that you don’t recommend it, but I was told that Parallels would allow me to
run Atlas.ti on my Mac until the software is available for Mac products. My husband bought me a new MacBook during
tax-free weekend and Parallels, but Microsoft has been out (not selling the
version) of the Windows product that I need to make Atlas.ti work on my
laptop. That was frustrating.
When Parallels wasn’t an option for me, I checked out one of
the netbooks that you reserved for our class. When it was returned by the
previous user, the netbook wasn’t wiped clean and it loaded a TON of files to
my DropBox account. That added stress to my semester, because I was SCARED TO
DEATH that I deleted somebody’s work that was needed for their
dissertation. I know that is why we have
back-up copies of everything, but I felt really bad. I just freaked out when I saw the strange
files and deleted before I thought. Another problem with the netbook that I had
was that every program on it was a trial version, so each time I tried to do
something it was expired and it had to be activated. I returned the Netbook and started using an
old laptop that my husband has, but it isn’t compatible with my new Mac program
for Office products.
All of that previous discourse (smiles) was just to point
out the difficulty/frustration that requiring one program can cause. Not only
did I have to learn the PC side of things and basically set up a program on two
different computers, but I had to learn Atlas.ti. Thanks to my literacy
education friends and YouTube videos, I have learned the basics. I STILL HAVE
TO LEARN A LOT ABOUT ATLAS.TI, because I have only touched the surface with
this program, which is to say that I know nothing. Another problem that I had was that the
method that I had for recording my data was an app on the iPhone and the
iPad. Before recording, I made sure that
the program would be able to save in a format consistent with DropBox and with
Atlas.ti. However, it wouldn’t allow me
to submit any audio file over 25 minutes.
They might’ve gone into DropBox, but Atlas.ti wouldn’t recognize the
file. Therefore, the conversational data
that was used for this assignment wasn’t my first, second, or third pick for
the assignment. The point to this rant is just to say that a lot of the time
that could have been devoted to reading more of the recommended texts for
learning more about DA was taken up by my efforts to try and learn
Atlas.ti. I still have no idea why you use the different
components of Atlas.ti (i.e., what purpose they are used for).
I still have access to the shared files from my semester in
Digital Tools with you. During the
intersession, my plan is to read through the notes from our class regarding
Atlas.ti, Ann’s Atlas.ti PP, Hollie’s Skillbuilder on Atlas.ti from her Digital
Tools class with you, and read through the training manual on the Atlas.ti
website in preparation for the Spring semester.
My husband is going to buy me a Netbook for the purposes of Advanced
Qualitative Research in the spring, so that I can learn to use and learn one
computer for that class. I am going to
spend time practicing Atlas.ti and getting the computer ready for the
semester. Also, since you mentioned that
we will pick an area/method of qualitative research to investigate deeply as
individuals in Advanced Qualitative Research in the spring, I am going to spend
up on either Case Study, Phenomenology, Narrative Analysis, and/or Ethics of
Online Data. If you think one is more
preferable than the other, please let me know so that no time is wasted.
Sunday, November 10, 2013
Final Blog:-( or ;-)
In a word, Discourse
Analysis means Doing Analysis. (Antaki et al., 2003)
I think that the overall arching connection between these
readings was that qualitative research is equivalent in its own right to
quantitative research, but that a problem that comes up in this line of work is
that the researcher doesn’t pay it the respect that it deserves. The research isn’t always done accurately,
the analysis is sloppy, or time hasn’t been devoted to developing the craft as
they should have. Researchers need to
spend time learning about what an interview is and isn’t. They need to recognize how to really do the
analysis, so that it is conducted and verified by the data itself, such as
being followed up in the next turn. This
isn’t easy work and if done correctly, provides everything that quantitative
researchers are looking for, i.e., validity, without all of those messy
numbers.
In terms of the Golato article, I found the concept of DCTs
interesting, but I was left with that feeling of ‘Duh!’ Humans are infallible. They are different. No interaction can ever truly be replicated,
because nothing can ever been the same in a subsequent interaction. For example, I am sitting on my couch typing
this paper and my husband has been researching vacation destination for us for
winter break. He was excited about taking
me on a beach vacation, because he knows how much I love the beach. When he got my deflated reaction about the
possible cold weather in late December, he went back to looking. From this point forward, every vacation
option he encounters that involves a North American beach will be viewed
differently than before. Our interaction
changed his perception. If he or someone
else tried to replicate our interaction, they would approach it with a
different stance.
Golato talked about the function of a compliment in a
classroom and non-institutional setting and it made me think about a southern
term that we have blogged about before, ‘Bless your heart.’ Anywhere in America that saying would appear
to be a sympathetic statement, but in the south, it probably means the speaker
thinks that the intended is an idiot.
Context matters. Background
knowledge matters. This also made me think
of Peter Johnston’s Choice Words or Opening Minds. The simplest of phrases can be interpreted in
a number of ways based on the context in which they are said or based on the
tone of voice or the mood that the participants are in.
Potter, J. &
Hepburn, A. (2011). Eight challenges for interview
researchers. For J.F. Gubrium and J.A.
Holstein (Eds) (forthcoming). Handbook of Interview Research (2nd
Ed.). London: Sage.
The irony is that qualitative interviews are massively overused, but
their potential has been massively restricted.
Our aim in this chapter is to make the case that
interviewing has been too easy, too obvious, too little studied and too open to
providing a convenient launch pad for poor research…faces up to a series of 8
challenges.
Set 1 (reporting to the interview study):
1)
improving the transparency of the interview
set-up (how participants are recruited);
2)
more fully displaying the active role of the
interviewer (interview is interactional, but not followed through in research
practice);
3)
using representational forms that show the
interactional production of interviews;
4)
tying analytic observations to specific
interview elements.
Set 2 (analysis of the interview):
5)
how interviews are flooded with social science
categories, assumptions and research agenda;
6)
the varying footing of interviewer and
interviewee;
7)
the orientations to stake and interest on the
part of the interviewer and interviewee;
8)
the way cognitive, individualist assumptions
about human actors are presupposed.
Golato, A.
(2003). Studying compliment responses: A
comparison of DCTs and recordings of naturally occurring talk. Applied Linguistics, 24(1), 90-121.
Golato argues that ‘recording naturally occurring
talk-in-interaction enables the researcher to study how language is organized
and realized in natural settings (pg. 90.’
Comparative studies (e.g. Yuan 2001) of role plays and
naturally occurring conversations have indeed shown that what is said and, more
importantly, how it is said differ drastically in role plays and in actual
conversations (pg. 94).
Study of classroom compliments versus non-classroom
compliments…’One cannot assume that compliment serve identical functions and
have the same design in ordinary and institutional talk (pg. 96).’
Goodman, S.
(2008). The generalizability of
discursive research. Qualitative research
in psychology, 5, 265-275.
‘I show how such findings (discourse analytic findings) can
be considered generalizable to the extent that they can show how a particular
discursive strategy will often bring about the same interactional results (pg.
265).’
-quantitative vs. qualitative comparison and definition of
generalizability: ‘The process of making statements about the general
population on the basis of relevant research (e.g., experiments or surveys).’
(pg. 265)
Qualitative researchers tend to accept that their findings
cannot be generalized in this way: instead generalizability is sacrificed in
favor of a more detailed understanding of the issue being researched (pg. 266).
Guba (1981):
qualitative researchers could replace this with what he called
transferability where findings within one context can be applied to another if
there is sufficient knowledge of the contexts in question (pg. 266).
To Edwards and Potter, social action refers to the
interactional accomplishment that a piece of discourse brings about. This may be, for example, the action of
remembering, blaming, performing prejudice, or any other outcome of social
interaction (pg. 267).
To conclude, where it has been widely accepted that
discursive psychological findings are not generalizable, I have shown that a
discursive strategy can be generalizable to the extent that the ‘action’ that
it accomplishes can be generalized across contexts (pg. 273).
Antaki, C., Billig,
M., Edwards, D. & Potter, J. (2003).
“Discourse analysis means doing analysis: A critique of six analytic
shortcomings.” Discourse Analysis Online,
1. Available from:
<http://www.shu.ac.uk/daol/articles/v1/n1/a1/antaki2002002-paper.html>.
‘Discourse analysis still can be misunderstood by those who
have been schooled in quantitative analysis.
It might appear to quantitative researchers that ‘anything goes’ in
qualitative work in general, and discourse analysis in particular.’
-Problems: researchers self-education, work produced
embodies basic problems
“Writers are not doing analysis if they summarize, it they
take sides, it they parade quotes, or if they simply spot in their data
features of talk or text that are already well-known. Nor are they doing analysis if their
discovery of discourses, or mental constructs, is circular, or if they
unconsciously treat their findings as surveys.”
‘It is safe to say that analysis means a close engagement
with one’s text or transcripts, and the illumination of their meaning and
significance through insightful and technically sophisticated work. In a word, Discourse Analysis means Doing
Analysis.
Golato Notes…
-purport actual language use: the forms and formats of a
compliment response, the comparison of compliment responses in different
languages (pg. 91)
-‘My results suggest caution in using DCTs if one’s goal is
to describe actual language use (pg. 91).
-administrative advantages of DCTs…researchers can better
control variables, quickly gather large amounts of data without transcription,
better ability to compare native and non-native speakers (pg. 92)
Goodman Notes…
Definitions:
-Validity: showing what it is claiming to show
-Construct Validity: show that the effect demonstrated can
be generalized from the measures used in the study to the fuller construct
-External Validity: being able to generalize the research
findings to the population in general
-Ecological Validity: the extent to which the research
findings can be generalized to other settings
-Population Validity: the extent to which the research
findings from the sample studied to the wider population
-Reliability: the extent to which a given finding will be
consistently reproduced where it is deemed that similar results will be
consistently found from the same research study (pg. 265-266)
-best known example of a generalizable conversational
strategy is that of the three-part list, where lists are consistently seen to
include three items to show that the list is complete, and that what is been
described is normative (pg. 268)
The analyst should be able to state that the following is
true in order to make a claim of generalizability:
1)
A discursive strategy can be shown to achieve a
certain rhetorical accomplishment.
2)
This strategy can be identified as being used in
a range of conversational settings in an attempt to bring about this rhetorical
accomplishment.
3)
If this strategy often brings about the same accomplishment
this strategy can be described as a successful strategy.
4)
It can be shown that successful strategies will
be used by a range of speakers in a range of contexts to bring about the same
rhetorical end. To this extent, it is a
generalizable example of an action performed by a rhetorical strategy.
5)
We may eventually begin to see opposition to
successful and generally used strategies (pg. 272).
Antaki et al…
Qualitative/Quantitative: Both want to do something with the
data. Neither is content merely to lay
the data out flat.
Transcription prepares the data for analysis. However, it is not the analysis itself.
Hutchby & Wooffit Revisited…
The most central of these assumptions is that ordinary talk
is a highly organized, socially ordered phenomenon (pg. 11).
At the most basic level, conversation analysis is the study
of talk. It is the systematic analysis
of the talk produced in everyday situations of human interaction,
talk-in-interaction (pg. 11).
One aim of CA therefore is to reveal this sequential
order...describable ways in which turns are linked together into definite
sequences (pg.42).
The next-turn is the place where speakers display their
understanding of the prior turn’s possible completion. The next speaker has
performed on the typed of utterance the prior speaker has produced (pg.42).
‘Paired Action Sequences that conventionally come in
pairs: questions-answers,
greetings-return greetings, invitations-acceptance/declinations (pg.42)
The format for agreements is labeled the ‘preferred’ action
turn shape and the disagreement format is called the ‘dispreferred’ action turn
shape (pg. 46).
‘dispreference markers’: turns that is some way depart from
what seems to be expected incorporate a variety of these, ‘well’ or ‘um’ (pg.
47)
Preferred actions are characteristically performed
straightforward and without delay, while dispreferred actions are delayed,
qualified and accounted for. The concept
refers to these structural features of turn-design and not to individual
motivations or psychological dispositions (pg. 47).
Organization of Turn-Taking:
1)
turn-taking has occurs
2)
one speaker tends to talk at a time
3)
turns are taken with as little gap or overlap
between them as possible (pg. 49.
Overlapping talk may be considered evidence of an incoming
speaker’s failure to take notice of whether the current speaker is or is not
finished (pg. 54).
Four varieties of repair sequences:
1)
Self-initiated self-repair: repair is both
initiated and carried out by the speaker of the trouble source.
2)
Other-initiated self-repair: Repair is carried
out by speaker of the trouble source but initiated by the recipient.
3)
Self-initiated other-repair: The speaker of a
trouble source may try and get the recipient to repair the trouble—for instance
if a name is proving troublesome to remember.
4)
Other-initiated other-repair: The recipient of a
trouble-source turn both initiates and carries out the repair. This is closest to what is conventionally
understood as ‘correction’ (pg. 60).
The first two places in which repair can occur are within,
or immediately after, the turn construction unit containing the trouble source
(pg. 62).
The second place in which repair can be done occurs
immediately at the next transition relevance place after the trouble source
(pg. 63).
CA also focuses on:
Gaps and pauses
Breathiness
Talk in Institutional Settings
Turn-type pre-allocation means that participants are
normatively constrained in the types of turns they may make according to their
particular institutional roles. Typically, the format involves chains of
question-answer sequences, in which the institutional figures ask the questions
and the witness, pupil, or interviewee is expected to provide the answers. This format is oriented to by participants,
but at the same time normative rules operate which mean that participants can
be sanctioned if they refuse to stay within the boundaries of the
question-answer framework (pg. 141).
A three-part list is simply a way of packaging a point or
position in an argument using a list of three separate items (pg. 183).
A contrastive device is means of packaging a point, where
one argument or approach is contrasted with another in such a way that the
speaker’s favoured position is seen to be superior (pg. 183).
While CA aims to describe the ways that participants display
that they are aware of specific contextual factors (by observably modifying the
ways that they talk, for instance), CDA maintains that there are other factors,
external to the situation the speakers are in, and of which the speakers may
not be aware, that impact on the production of their talk (pg. 210).
Wednesday, November 6, 2013
CMC Research...Blogs
This was one of the topics that we read in DP and I have to say that I had a new perspective when I was reading it this time based on my personal research interests. I understand that for the purposes of this study that you were working with students and that IRB was used to explain that the students grades were not contingent upon participation in the research project, etc. What other considerations were taken to protect the students/participants and the researcher/instructor? I am now interested in conducting research using social media sites for my research, such as Facebook, Twitter, blogs, etc. It's not my desire to use this for my entire dissertation, but I am interested in having it as a piece of my data. We've 'talked' previously about one of the issues with using FB posts as data is that participants login with a password and there is the question/issue of privacy in a public domain. You mentioned that a difficulty that I might run across is the participants who don't sign consent. Would I not be able to use any data from a page if one person didn't consent? What if I started my own FB page on the subject and put a disclaimer on the page as one measure?
I had my first experience moderating a class on BB this past weekend and it made me think of your study. There were different levels of participation from the more 'peacock-ing' students to the 'Well I better work at participation point' students to 'I wonder if the professor even knows I'm here' slugs. It also made me think of my experience in Digital Tools with the classes we had via BB or Skype. It was awkward and I know how that hindered by participation (along with confidence issues).
Accountability and
displays of knowing in an undergraduate computer-mediated communication context
(Lester & Paulus, 2011)
In this study, we draw upon elements of discursive
psychology as we oriented to what was happening in the talk from the participants’
perspective in addition to what should be happening from the
researcher/instructor perspective (1).
Our findings point to how students negotiate and at times
resist doing being a knowledgeable student, using disclaimers, such as ‘I don’t
know’ and script formulations to minimize accountability for their posts (1).
Activating prior student knowledge on a topic and
encouraging reflection on new information are strategies that have long been
considered useful for learning (Dewey, 1933).
A great deal of research has examined CMC discussions in
educational environments, most notably asynchronous discussion forums, for
evidence of learning, evidence of argumentation, collaborative knowledge
building, and cognitive presence (2).
Friesen and Hug…suggest that researchers attempt to orient
to the participant perspective of the discussions rather than the researcher’s
perspective alone, shifting their focus from what should be happening (e.g.
particular argumentation structures) in these environments to what is
happening. As Stokoe (2000) points out,
there’s a long history of attempting to categorize, classify, and evaluate
different kinds of classroom talk, yet’…good or successful educational
discourse is’ an ‘abstract notion’ and often quite difficult to determine (p.
186).
DP assumes that ‘psychological phenomena can be investigated
without seeking to fix their causal origin in a hidden and speculative mental
of cognitive domain as conversational contributions and interactions are shown
to possess a startling complexity and an explanatory self-sufficiency’
(Friesen, 2009:143).
‘knowing’ is understood as bound up and embedded within
interactions, with language being understood as constitutive (3).
This study looks at undergraduate blogging conversations in
the context of an introductory nutrition science course (3).
-situated within DP, which draws upon discourse analysis,
ethnomethodology, conversational analysis, and rhetorical psychology (4)
-focus on three broad themes from DAM: 1) action, 2) fact
and interest, and 3) accountability (Edwards and Potter, 1993; Potter et al.,
1993)
-approached data through 1)repeated readings; 2) selection
organization, and identification of patterns, 3) generation of explanations; 4)
noting variability and 5) reflexive and transparent documentation of our claims
(4-5)
The purpose of this task was to provide an opportunity for
students to 1) activate their prior knowledge on the topic of dietary
supplements, 2) engage and interact with their peers, and 3) reflect on what
they had learned. We assumed students may be motivated to post in the online
blogging environment as they completed the task (4).
Publicly displaying knowledge is not an easy request for
students (10).
Students used discursive resources to downplay their
personal accountability for the task (11).
Arminen (2005) discussed five basic patterns of classroom
talk: lecturing format, pedagogic cycle, repair sequences, correctional
activities and organized extra-curricular activities (11).
Making learning
ordinary: ways undergraduates display learning in a CMC task (Paulus &
Lester, 2013)
The pedagogic cycle, also known as the
initiate-respond-evaluate/feedback pattern involves students being asked a
question to which they respond and subsequently receive an evaluation by the
instructor. This pattern can be used to
maintain order and control in face-to-face classrooms where one authority
figure is responsible for numerous students (54).
A DP perspective orients to psychological constructs, such as
cognition and learning, as ‘objects in and for interaction’ (Potter, 2005:
789), and assumes that they are situated in and made visible through discursive
practices (55).
By shifting the spotlight away from students’ private minds
we, as analysts, instead ‘approach discourse (learning) as a social practice
rather than mental expression’ (Edwards, 1999, 288).
For the purposes of this study, we were interested in
exploring the construct of learning as a situated practice within the context
of a CMC task designed to elicit learning displays from undergraduate students
(55).
Sacks (1984) describe how people go about doing “being
ordinary” in everyday life and will work to normalize any unusual or
extraordinary occurrences. Sacks argued
that we go to great lengths to present our experiences in accepted, normal
ways. Asking students to write about (or
verbally report) what they have learned is asking them to make public the ways
in which they may be different from their peers, or to orient to something as
not ordinary, rather than ordinary (56).
An extensive set of CMC data generated at a research
university in the southeastern region of the United States (with IRB approval)
-undergraduates in large nutrition course
-required blogs
During this first step of analysis, we met regularly to read
each post out loud, recording our individual and joint reflections about those
sections within each post that we initially found most intriguing (Potter and
Wetherell, 1987).
As we re-read, the following broad, discourse analytic
questions sensitized our analytic process (Potter, 2004):
1.
What are the students accomplishing with their
posts?
2.
How are they constructing their blog posts in
order to achieve this?
3.
What discursive practices are being used to
perform these tasks? (58)
Findings:
-learning as an extreme change of state (I was amazed)
-learning as a neutral assessment of news
-learning as denying a change of state
Arminen (2005) argued that a major institutional purpose of
primary and secondary schooling is to develop the ability to react to new
information (often presented through lectures) in a neutral manner rather than
according to one’s personal experiences or preferences. He suggested that it is instructor assessment
and feedback via the pedagogic cycle that maintains student engagement in the
absence of connections with personal experience (64-65).
As educators we should acknowledge that engaging in CMC
conversations can be a delicate matter for students, and the more delicate the
matter, the more attention needs to be given to preparing students to manage
dilemmas presented by the tasks in ways that do not directly conflict with the
pedagogical outcomes of such tasks (66).
Subscribe to:
Comments (Atom)
