Monday 22 November 2010

Reliability and validity of qualitative and quantitative data in surveys

This section will focus on the definition and the methods of evaluating reliability and validity in survey research.

Reliability and validity is a major issue when it comes to research, indeed failure to assure the validity and/or reliability of the findings may cause the research to be questioned even worse rejected as invalid.

Reliability refers to consistency and/or repeatability of the measurement; in other words, consistency can relate here to the questionnaires being clear and well define in order to not confuse the respondents and repeatability here means that if searchers have findings from a group they should be able to repeat the survey and get exactly the same results.

Consistency:

There are several ways to measure survey research consistency;

Qualitative research:

Consistency may be measured by using triangulation; this will be done using multi sources of information for example by taking different information from three different investigator or just by combining more than one methods of data collection in the same research; interview and survey and so on. This will actually fructify and increase consistency of the research and therefore reliability as well. The advantages from this approach are that is time consuming, expensive and request lots of effort.

Quantitative research:

Consistency could be measure by using one or more following strategies:

  • Inter-Rater or Inter-Observer Reliability
  • Test-Retest Reliability
  • Parallel-Forms Reliability
  • Internal Consistency Reliability

This will also result the findings to be reliable.

Validity refers to the degree to which the measurement procedure actually measures the concept that it is intended to measure.

Validity research has several ways to be obtained:

  • Face validity
  • Content validity
  • Predictive validity
  • Concurrent validity

The picture below shows us the relativity between reliability and validity; it gives us a well descriptive view of the relationship between reliability and validity.

As the picture shows, there are four possibilities, first possibility the measure can be reliable but not valid, second one the measure may be valid but not reliable, the third one is the worst case where the measure are neither reliable and not valid as well however the last measure is a perfect case where we have both reliability and validity.

To conclude from the picture, we noticed that reliability and validity have related ideas however one can work without the other one, or both at the same time.













References:

William M.K. Trochim. (2006). Types of Reliability. Available: http://www.socialresearchmethods.net/kb/reltypes.php . Last accessed 18th Nov 2010.

Adri Labuschagne. (2003). Qualitative Research - Airy Fairy or Fundamental?. Available: http://www.nova.edu/ssss/QR/QR8-1/labuschagne.html . Last accessed 18th nov 2010.

Celia Taylor, Graham R. Gibbs and Ann Lewins. (2005). Quality of qualitative analysis. Available: http://onlineqda.hud.ac.uk/Intro_QDA/qualitative_analysis.php . Last accessed 18th nov 2010.

William M.K. Trochim. (2006). Reliability & Validity. Available: http://www.socialresearchmethods.net/kb/relandval.php . Last accessed 18th Nov 2010.

6 comments:

  1. This post is very important in terms of the outcome of the research. It clearly show the importance of the right choice of the data collection method. A wrong design or approach to a questionnaire can lead to waste of time and money invested in the research, because invalid and unreliable data might mislead the whole data collection.

    ReplyDelete
  2. This comment has been removed by the author.

    ReplyDelete
  3. There are various methods of data collection which includes the following: Internet data, books and guides, observational data, personal interviews, questionnaires, group discussions, and use of experiments. Read further. See more collecting quantitative data

    ReplyDelete
  4. Thanks for nice information.
    We offer concise and insightful analysis on the Indian Economy
    through our regularly updated macroeconomic data, commentary and interactive charts.

    Refers at:

    National Income India
    Real GDP India
    Consumption data India
    Capital formation India

    ReplyDelete
  5. LE-MERIDIAN FINANCING SERVICES. the loan company that grant me loan of 5,000,000.00 USD When other loan investors has neglect my offer but Le_Meridian Funding Service grant me success loan.they are into directly in loan financing and project  in terms of investment. they provide financing solutions to companies and individuals seeking access to capital markets funds, they can helped you fund your project or expand your business.. Email Contact:::: lfdsloans@lemeridianfds.com Also  lfdsloans@outlook.com or Write on whatsapp Number  on    1-(989-394-3740)Good Intend,

    ReplyDelete
  6. Other triggers have also been identified and these include stress, anxiety, and seasonal changes. The second area of interest focuses on the possible causes of IBS. Dr. Saunders has carried out research in this field but this is yet to yield definitive results. To get more detailed info on research onion, visit on hyperlinked site.

    ReplyDelete