Showing posts with label theme 4. Show all posts
Showing posts with label theme 4. Show all posts

Sunday, 11 October 2015

THEME 4 - Comments - Quantitative Research

Links to the comments I've made
  1. On comparison between different studies - Post-Seminar
  2. On reliability for subjective ideas - Post-Seminar
  3. On "objectivity", numbers and quantitative research - Post-Seminar
  4. On wicked problems - Post-Seminar
  5. On controversial subjects and quantitative research - Post-Seminar
  6. On the choice between quantitative and qualitative - Post-Seminar
  7. On precision and quantitative research  - Post-Seminar
  8. On objectivity - Post-Seminar 
  9. On variable control and dependence - Post-Seminar
  10. On having the same paper and advancing together towards understanding - Post-Seminar


Saturday, 3 October 2015

THEME 4 - Post-Posting - Quantitative Research

This week's theme was an eye-opener for me. I have always put more value in quantitative research rather than qualitative research. After having read the recommended literature, and selected one paper for our pre-seminar, I realized I couldn't have been more wrong. 

Indeed, during the seminar we talked about objectivity: just like in last week's theme, we're generally very quick to brandish words like "truth", "objective", "false", "subjective"… But in research, it's best not to resort to that, as we very often realize that the results we get can't help but be related to the way we've designed the study, within our certain framework, set of data, decisions and starting concepts. Why have we chosen drums, and not piano? Why white people and not black people? 
In this sense, while the general preconception would be that because quantitative studies often produce results in the form of numbers (which we, as scientists, love, worship, and more specifically don't question… sadly), we think they're more "reliable", more likely to be accepted. I was in this case as well. Thankfully, the seminar and lecture changed my point of view: now that I know the design of the study is the one subjective, questionable, deniable, point, I realize that a big part of the study's reliability boils down to the skills of the researcher - might the study be quantitative or qualitative. Best would be that it's a mix of both. 

In this sense, deciding to conduct a quantitative/qualitative study generally comes parallel to the design process - there are things more adapted to be quantified than others, for example character and personality traits generally would be difficult to reduce to just a few numbers. The same goes in terms of "wicked problems" : trying to quantitatively design a product to solve that problem only using measurements isn't enough, we have to go into many more aspects - and thus, controlling the outcome becomes much more hazardous. That's why we have to use a mix of quantitative and qualitative. While the standardization of the quantitative methods offers the possibility to have a uniform metric for different people, the benefits of having the possibility to vary our measurements sure show when we use a qualitative method. By doing this, we get deeper knowledge, and an interrelation between the results that quantitative and qualitative methods give us. An example that illustrates the benefits of the comparison would be conducting a qualitative method to measure the amount of candy you ate last week (do you feel you ate a lot of candy? Or little ?) then, conducting a quantitative method, and comparing results: this would shed light on our perception of quantity, on the concept of guilt, or want… But of course, it still depends on sample selection (for the quantitative method), question and test implementation… Everything that makes research interesting, captivating, and of course, complicated. 

Thursday, 24 September 2015

THEME 4 - Pre-Posting - Quantitative Research

 The effect of Twitter on college students engagement and grades (R. Junco, G. Heiberger, E. Loken)
Social media use in an educational background has long been known to be beneficial for both students and teachers, however very little empirical evidence is available to back up said presumption. Junco, Heiberger and Loken's paper provide an experimental quantitative study to determine the impact of Twitter use on the engagement an grades of a sample of american college students.
In this paper's case, the observable phenomenon that was quantified using scientific methods was the impact of Twitter use on engagement and grades improvement: by using 19 selected psychometric properties from the National Survey of Student Engagement (NSSE), an established instrument that was developed to measure engagement in school, the authors measure engagement qualitatively while assessing differences in engagement and grades by using a quantitative mixed effects analysis of variance (ANOVA) models with class sections nested within treatment groups. They also conducted content analyses of samples of Twitter exchanges. 
The authors also calculated the Cronbach's alpha to their studies (0.75 for the pre-test and 0.81 for the post-test) to estimate the reliability of the psychometric test results administered to the students, and compared it to two other studies similar to theirs to further back their study up: this shows their paper is reliable and the use of the quantitative methods gives an empirical take on this very common assumption that social media in school gets the students more engaged and helps them improve their grades. I also think they could have done with a bigger sample. 
While the measure of engagement and the impact of twitter on it and on grades is backed up by significant data and established quantitative methods, I'm not sure about the content analyses of samples of Twitter exchanges, on which they base a number of assumptions and conclusions related to the benefits in terms of skills Twitter gives student, because they don't get into details about the adopted quantitative method… 
 Drumming in Immersive Virtual Reality : The body shapes the way we play (K. Kilteni, I. Bergstrom, M. Slater)
Immersive Virtual Reality is a subject that more and more people are becoming interested in, because they can envision its very important role in the future of many actual fields - be it video gaming or information sharing. Now in this paper, immersive virtual reality is used in a very different angle, as a means of demonstrating how the body can shape the way we play. Indeed, by enabling study participants to play drums in an immersive virtual reality where they had different avatar bodies, the authors underline that the way we perceive our bodies could impact our drumming technique. 
The research is based on a mix of quantitative and qualitative methods : the quantitative methods were used to analyze the data collected through various sensors in a way that could be useful to the study, while the quantitative methods served to assess participants' personalities, as a background control that said personalities didn't impact on the drumming performance. I believe this mix is really efficient in making the study that much more reliable : quantitative methods use is compatible with data collection because it's, as data is, undeniable and objective. With the numbers and the scientific process applied to them, the results that come out are both satisfactory and reliable (if the data-collection is sufficiently spread on various samples), while qualititative method use is relevant in the case of personality analysis, because it's very often based on a questionnaire leveraged with a Likert scale: questions are much more adapted to personality assessment than any other data collection and process could ever be, because how are you supposed to effectively assess someone's character/personality based on nervous signals and numbers? In this sense, quantitative methods and qualitative methods each have their own specificities and ups/downs, that make each of them more relevant for a certain type of research and theory foundation.