Factors Should be Considered for Defining Data for Research

Bangladesh Education Article
Bangladesh Education Article
Written by Goutam Roy


Data are the raw materials with which a research can build. The term data means systematically collected groups of information that represents the qualitative or quantitative attributes of a variable or set of variables. Data are typically the results of measurements and can be the basis of graphs, images, or observations of a set of variables. It often viewed as the lowest level of abstraction from which information and knowledge are derived. Data collection itself involves administrating instruments as well as gathering and organizing responses and measures for analysis. So for making a well planned data collection process, the major task is to define data clearly that it can fulfill the research requirement. Researcher may bring different assumptions to his work; data gathered by different methods may provide different windows onto social world (Gilbert, 2008).

Now the question requires explaining the factors which are need to define data of a study. That means, before starting data collection, what would be the essential steps in order to meet the research demand. Basically, researcher needs to interconnect with theory and methods which affect each other   . Data is meaningless in the absence of a theory. Absence of it, no reasonable operational techniques or inductive procedures exist for extracting anything from data which can lead to insight or understanding in focus area. Beside this, the theory is needed for deciding the methods of gathering data. For instance, descriptive theories are the generated and tested by descriptive research which can employ empirical methods of data collection. The several factors which are needed to define data are described below.

Principle of the Research
The research process usually begins with the theoretical perception or formulation of the research topic (Sarantakos, 2005). Before start, researcher obviously needs to have some ideas on what area he going to deal with. Finding the focus involves identifying what is the researcher wants to gather information about (Robson, 2002). Except this, a planning for doing research is impossible. For instance, a researcher has an interest to understand why students dislike mathematics. However, this initial interest is far too broad to study in any single research project. The researcher has to narrow the question down to one that can reasonably be studied in a research project. This might involves formulating a hypothesis or a focus question. Researcher might hypothesize that a particular mathematical method avoided by school students in a specific district. At the narrowest point of the research hourglass, the researcher is engaged in direct measurement or observation of the question of interest. The principle of the research should be clearly defined by researcher; it can be varying but the presence and necessity are taken for granted (Sarantakos, 2005).  There are three basic research paradigms – positivism (quantitative, scientific approach), interpretivism (qualitative approach), and critical science (Cantrell, 2006). These paradigms based on assumption of the world.

The term ‘Positivism’ has applied to conventional approach to research which incorporates methods and principles of natural science for the study of human behavior (Burns, 2000). It includes a fairly sharp distinction between theory and research and includes elements of both deduction and induction (Bryman & Teevan, 2005). Actually, social research demands solid and repeatable results. Before initiate a research project, a researcher faces the confusion on using appropriate theoretical perspectives, methodologies and the philosophical basis that need to encompass. This seemingly meticulous structure for the research process is aimed toward providing the researcher with a direction which they can go on to develop themselves to coincide with their particular research purposes (Cortty, 1998). Once a researcher has developed a set of research questions, he must consider what methods going to employ in the research, what theoretical perspective lies behind the methodology, and what epistemology informs this theoretical perspective. This will have a salient impact on the kind of data which can collect in order to validate their arguments concerning the methodology. A researcher’s choice of methods will be conditioned by theoretical perspectives, the way one sees the social world. Researchers can use a wide variety of research methods to gain and enhance knowledge and theory. The different types of research methodologies, quantitative and qualitative, are associated with the epistemological and theoretical perspectives the researcher wishes to adopt.

Positivism means scientific approach, which is suitable for quantitative research. On the other hand, interpretivism, or the qualitative approach, is a way to gain insights through discovering meanings by improving our comprehension of the whole.  These two methods of reasoning have a very different “feel” on conducting research.  Qualitative research explores the richness, depth, and complexity of any phenomena. Broadly defined, any kind of research that produces findings not arrived at by means of statistical procedures or other means of quantification (Corbin & Strauss, 2009). Before using qualitative techniques, it is essential to cover some general issues about the nature and purpose of qualitative enquiry (Travers, 2001). Researchers have to have a good reason to choose interview, observation, focus group or other kind of qualitative method. The underlying assumption of interpretivism is that the whole needs to be examined in order to understand phenomena.  Interpretivism is critical of the positivism because it seeks to collect and analyze data from parts of a phenomena and, in so doing, positivism can miss important aspects of a comprehensive understanding of the whole. Interpretivism proposes that there are multiple realities, not single realities of phenomena, and that these realities can differ across time and place. Unlike quantitative research, there is no overarching framework for how qualitative research should be conducted; rather each type of qualitative research is guided by particular philosophical stances that are taken in relation by the research to each fact.

Critical Perspective
All scientific research, indeed all human knowledge, follows a set of procedures that must begin with a group of assumptions, a set of beliefs and a paradigm. However, once a paradigm for research has been chosen, it is by no means settled what strategies and types of data collection and analysis are to be employed. All too often, research studies are criticized for their methodology without any consideration of the paradigm within which they fall. The critical theories are regularly used in post-modernism, advocacy and feminist research. Both quantitative and qualitative methods can be utilized and researcher has to employ value-laden methods and procedures. Critical researchers assume that social reality is historically constituted and which produced and reproduced by the people. Although people can consciously act to change their social and economic circumstances, critical researchers recognize that their ability to do so is constrained by various forms of social, cultural and political domination. The main task of critical research is seen as being one of social critique, whereby the restrictive and alienating conditions of the status quo are brought to light. Critical research focuses on the oppositions, conflicts and contradictions in contemporary society, and seeks to be emancipator.

The Research Process
Before starting a research project, the questions comes first, ‘where do begin’ and ‘what is the next step’ or ‘what is the first step for doing research’ and ‘what would be the right step after that’. The first step towards doing research is to develop a research plan which can describe the summary of its main elements; what would be studied and how it would be accomplished; and finally how the data would be gathered, analyzed and published. This manner which would be conducted is determining the methodology that underlies in the research. Researcher can adopt different way to conduct qualitative and quantitative research. Basically any research process has five basic criteria but before data collection the three major steps should be perform by the researcher. Firstly, the research topic and methodology should be decided. After that, the methodological construction of the topic, and then the sampling procedure should be determined. Subsequently, data collection plan and execution, fourth data analysis and interpretation and finally the report writing procedure would be followed. Here, the steps before defining data are summarized.

Define Research Goals and Objectives
An important initial step before defining data is to make an inventory of the type of data researcher wants to collect and from whom it would be collect. Research questions can use as a guideline in order to define goals and objectives. Most social research originates from some general problems or questions. Usually, the problem is broad enough that could not hope to address it adequately in a single research studies. Consequently, researchers typically narrow the problem down to a more specific research question that can hope to address. The research question is often stated in the context of some theories that has been advanced to address the problem. Researchers may use different approaches in collecting data, such as the grounded theory practice, narratology, storytelling, sample survey, classical ethnography, or shadowing. Qualitative methods are loosely present in other methodological approaches, such as action research or actor-network theory. Forms of the data collection can include interviews and group discussions, observation and reflection field notes, various texts, pictures, and other materials.

Define Nominal and Operational Definitions
In methodology, it should clearly define what type of data will be collected and how it will accomplish. It should be decided what is going to evaluate and determine, how a numerical value will assign. In research, conceptual definitions can explain what researcher constructs by showing how they relate to other constructs. This explanation and all of the constructs it refers to are abstract — their existence is only as real and concrete as the thoughts researcher have. To work with constructs, researcher must have to establish a connection between them and the concrete reality in practice. This process is called operationalization. Operational definitions describe the variables will use as indicators and the procedures will use to observe or measure. Researcher needs an operational definition because he can’t measure anything without one, no matter how good conceptual definition it might be. It is best way to obtain complete understanding of an agreement on all the applicable definitions, procedures and guidelines that will be used in data collection process. Overlooking this step can be creates misleading results if interpreting loosely defined terms differently when collecting data. In case of examine historical data, careful attention should be paid to how reliable the data and its source have been, and whether it is advisable to continue using such data. Data that proves to be suspect should be discarded.

Ensuring Repeatability, Reproducibility, Accuracy and Stability
In social research, data being collected and measured will be repeatable if the same operator is able to reach essentially the same outcome multiple times on one particular item with the same equipment. Also, data will be reproducible, if all the operators who are measuring the same items with the same equipment are reaching essentially the same outcomes. In addition, the degree to which the measurement system is accurate will generally be the difference between an observed average measurement and the associated known with a standard value. The degree to which the measurement system is stable is generally expressed by the variation resulting from the same operator measuring the same item, with the same equipment, over an extended period. To improvement this situation, researcher have to cognizant of all the possible factors that would cause reductions in repeatability, reproducibility, accuracy and stability – over any length of time – that in turn may render unreliable data. It is good practice to test, perhaps on a small scale, how the data collection and measurements will proceed. It should become apparent upon simulation what the possible factors are, and what could be done to mitigate the effects of the factors or to eliminate the factors altogether. Many researchers thought that validity is more important than reliability because if an instrument does not accurately measure what it is supposed to, there is no reason to use it even if it measures consistently (reliably). There is a common misconception that if someone adopts a validated instrument, he does not need to check the reliability and validity with his own data. However, there can be validity without reliability and any repetitive measurement needs to change and examine. In addition, low reliability is a signal of high measurement error which reflects gaps between respondent’s actually knowledge and what they answered.

Improving Measurement System and Construct Data Collection Guidelines
Measurement is the assignment of numbers to objects or events in a systematic approach. Four levels of measurement scales are commonly distinguished: nominal, ordinal, interval, and ratio. There is a relationship between the level of measurement and the appropriateness of various statistical procedures. These scales of measure are expressions that typically refer to the theory of scale types developed by the psychologist Stanley Smith Stevens. It is important to very clear what are measuring, how it is to be measured, and who is to measure it.  Many statistical methods are appropriate only for data of certain measurement scales. When selecting a statistical method, it is essential to understand how the data to be analyzed were measured. The best stage of investigation for thoughtful measurement scales is the design stage, at which the statistical limitations imposed by certain measurement scales may influence your choice of observations and methods of measurement. There are several crucial steps that needed to be addressed to ensure that the data collection process and measurement systems are stable and reliable. Incorporating these steps into a data collection plan will improve the likelihood that the data and measurements can be used to support the ensuing analysis. To describe these steps, a checklist, populated with dummy responses, is also provided to illustrate the importance of building a well-defined data collection plan prior to execution.

There is common understating, sample is a part of a population whose properties are studied to gain information about the whole (Webster, 1985). It is a process of selecting respondent form larger part for the purpose of a study. There are several types of sampling techniques are used in research but there is danger to use inappropriate sampling technique.  Researchers have to have a keen understanding on different types of sampling procedure, determine sample size, sampling errors and also the way of minimizing these errors. Deciding on a sample size for qualitative inquiry can be even more difficult than quantitative because there are no definite rules to be followed. It will depend on what the researcher wants to know, the purpose of the inquiry, what is at stake, what will be useful, what will have credibility and what can be done with the available time and resources. In sampling, the sample should be judged on the basis of the purpose and rationale for each study and the sampling strategy used to achieve the studies purpose. Prior to any data collection, pre-collection activity or piloting is one of the most crucial steps in the process. It is often discovered too late that the value of the interview information is discounted as a consequence of poor sampling of both questions and informants and poor elicitation techniques. After pre-collection activity is fully completed, data collection in the field, whether by interviewing or other methods, can be carried out in a structured, systematic and scientific way.

Defining data is not easy process, a well defining research topic, research questions and hypothesis are the base of obtaining accurate and consistence information. After that, establish an operational definition and create a suitable measurement scales which need to standardize by testing several times. Researchers have to skill enough to blend his theoretical knowledge with the practical situation. A long and careful planning is needed before data collection. Data Collection is an important aspect of any type of research study. Inaccurate data collection can impact the results of a study and ultimately lead to invalid results. Different ways of collecting evaluation data are useful for different purposes, and each has advantages and disadvantages. Various factors will influence to choose choice of a data collection method: the questions researcher wants to investigate, resources available to him, his timeline, and so on. A formal data collection process should be well-defined and accurate that embodied validity in the findings.

Works Cited
Bryman, A., & Teevan, J. J. (2005). Social Research Methods. Ontario: Oxford University Press.
Burns, R. B. (2000). Intruduction of Research Methods. London: Sage Publications.
Cantrell, D. C. (2006). Alternative paradigms in environmental education research: The interpretive perspective.
Corbin, J., & Strauss, A. (2009). Basics of qualitative research: Techniques and Procedures for Developing Grounded Theory. The Weekly Qualitative Report , 140-143.
Cortty, M. (1998). The foundations of social research: Meaning and perspective in the research process. London: Sega Publications.
Gilbert, N. (2008). Researching Social Life. London: Sage Publications Ltd.
Robson, C. (2002). Real World Research. Oxford: Blackwell Publishing.
Sarantakos, S. (2005). Social Research. New York: Palgrave Macmillan.
Travers, M. (2001). Qualitative Research Through Case Studies. London: Sage Publications.
Webster, N. (1985). Webster’s International Dictionary of the English Language. United States: Random House.

Writer: Research Associate, Research and Evaluation Division, BRAC, Dhaka, Bangladesh. Email: [email protected]

About the author

Goutam Roy

Leave a Comment