You are on page 1of 52

REVIEW AND EVALUATION OF LITERATURE

Shri Prakash

Introduction
Review of literature is an integral part of research. In fact, reviewing the existing literature may itself be research. For example, a review article, with a view to settle i) existing state of knowledge, ii) dimension and nature of contribution of different authors, and iii) gaps in knowledge, is prepared on the basis of a survey and critical evaluation of the studies that have already been done by the predecessors or contemporaries. Such review articles may often be prompted by the appearance of outcomes of some new research in the form of a book. But then the review will not be confined to one study, it will cover the entire area or the theme under study. Such review articles may embody contribution of its author also, and hence, it will constitute research itself.

The review article may be published in a professional journal. Johnson and Bhagwatis survey of research in international trade is an example. Contributions to Indian economy, authored by Sen and Chakravarty, a monograph, may also be considered as a good piece of research based on such survey research. But survey research may also be published as a book(s). For example, different volumes of Survey of Research in social sciences in India, published by ICSSR, illustrate such comprehensive survey based research. Besides the above, the review of books is almost regularly published in the professional journals as well as news papers. Then, a brief but succint recapitulation and evaluation, based on an objective review of the particular aspects of earlier studies, are included in research papers either to provide i) the contextual, theoretical and / or policy framework of a given study; or ii) comparison and contrast of the findings of the particular study with those of other studies; or iii) support the findings of the study that cites results of other studies.

The role and importance of review of literature in an M.Phil. / Ph.D. thesis is even more than this. Hence, in the Ph.D./M.Phil. thesis, Review of Literature is an essential component of the chapter scheme, which is generally spelled out in the synopsis of the thesis itself as well as the first chapter of the thesis. It is, therefore, important that one understands the a) Need for, b) Meaning, c) Role and Functions, d) Technique(s), and e) Parameters in terms of which literature is reviewed. Organization and structure of the Review Chapter and actual portrayal of the Review of Literature have an important role to play in a thesis. Besides, review of literature performs varied roles in a research investigation. These roles endow the review with an importance of its own, while it facilitates proper explanation of the research problem, appreciation and understanding of the findings in the contextual or theoretical framework, that is also essential for the highlighting of the nature and direction of the contribution of the given study, and which may also enhance the significance of the findings of an investigation.

One should, however, know how to choose the studies for review from the studies available on a particular subject of investigation, since the rapid growth of knowledge and the consequent burdgeoning of literature rules out the possibility of all studies being reviewed comprehensively by one single scholar in any one single study. One has perforce to be choosy and selective in identifying the studies for inclusion in the chapter that is focused on review of literature in the dissertation. But one should have the knowledge and skills to undertake the review of literature so as to fulfill the objectives that the review is usually designed for so as to make it play its roles effectively and discharge its functions efficiently.

Meaning and Types of Literature


First question for the proper selection of studies for review is what is literature and second, why does one need to review and evaluate literature relating to the problem of investigation? It is a well established fact that research does not and can not take place in a vaccum. Each research investigation may have some antecedent and / or context and background. The fact is that innumerable problems happen to have been investigated by a number of researchers at any time.

But each investigation might have highlighted a) several gaps in knowledge, and unsatisfactory state in many other areas might have emerged in the light of new knowledge or understanding of a problem, b) methods used might have left one dissatisfied, c) interpretation(s) might not be convincing, and/or c) empirical evidence might have been inadequate, or new evidence might have been unearthed, or d) new theoretical paradigm(s) may be found to be more appropriate for the understanding of the problem. Anyone or a combination of these may prompt the reinvestigation of an already studied problem. It is, therefore, not necessary that one always picks up totally new problem for investigation. But then one has to be familiar with what others have done and how, for which review of literature is helpful.

Besides, the work that has already been done, if any, can not and should not be overlooked. This is what Popper says in this connection, Among the many methods which the researcher may use, depending on the problem in hand, one method seems to me worth mentioning. It is a variant of (at present un-fashionable) historical method. It consists, simply, in trying to find out what other people have thought and said about the problem in hand: why they had to face it; how they formulated it; how they tried to solve it. This seems to me important because it is part of the general method of rational discussion (1968, pp. 16-17). Thus, review of literature may promote rational approach to understand the nature and causes of the problem of investigation, an appropriate formulation of the research problem and the awareness about the probable solutions of the same. In the absence of the knowledge of the existing knowledge, one may compromise rational approach to research on more than one count.

It we ignore what other people are thinking or have thought in the past, then rational discussion must come to an end, though each of us may go on happily talking to himself. Some philosophers have made a virtue of talking to themselves; perhaps because they felt that there was nobody else worth talking to. I fear that the practice of philosophizing on the some what exalted plane may be a symptom of the decline of rational discussion. No doubt God talks mainly to himself because he also considers no one worth talking to. However, we are mere mortals, having an imperfect knowledge. Accordingly, even a philosopher should know that he is no more godlike than any other man (Popper, p17). The need for review of literature is thus obvious.

Need for rational discussion apart, it is common knowledge that the re invention of wheel shall not only be a wastefully directed effort, it shall be Don Quixotic also even though millions of wheels may be produced daily. Then, discussion of others views and findings will make the study comprehend the direction and area of gaps in the existing knowledge. This will impart a dynamics of its own to the investigation, broaden its horizon and make its direction and thrust pointed. The other question that a scholar will like to understand and answer is what is the meaning of review of literature and what does constitute literature?

Meaning of Review
The word Review comprises of Re and View. Re means again. Again may imply viewing second or even more times, though viewing is not visual viewing in the literal sense. View means an inspection by eye or mind. View may be formed on the basis of impression one gains from such an inspection. The inspection by eye requires concrete visuals to provide the basis for the forming of an impression through mental processes about the object of inspection, say, a painting, monument or artefact: The impression derived from inspection by eye or mind will convey the power of seeing and or perspective / vision based on the mental absorption of the portrayal.

But review of literature focuses on knowledge generated by scholars; the knowledge is not a concrete object, though it may be embodied and portrayed or conveyed through concrete objects like books, journals, paintings, artefacts etc.. So review of literature has to be based on images or impressions gained by mental eyes through logic and analysis. Then, the view in the context of literature refers to the other view of knowledge embodied in a given investigation. It is important to understand this aspect of review, since critics review music concerts, exhibition of paintings, and films also. The second or the subsequent View emerges from the mental image or impression about a study and the contribution it makes towards the advancement of knowledge. View may, therefore, connote the manner of considering a subject, weighing an opinion or assessing an attitude.

Review will, therefore, connote a second view based onreexamination of a study. Review means second view, view again, or display and the process of formal examination or survey for a fair but critical evaluation. Review of literature may thus mean taking a second view or re-evaluation of a study that has created some space for itself in the given field of knowledge, when it was viewed first or was furnished initially by the author. Review may thus refer to an objective and independent evaluation of the findings of a study, subsequent to its completion and dissemination, by some scholar(s) other than the author(s) with a view to put it proximately in the context of existing knowledge and evaluate the contribution that it has made to the understanding and explanation of the phenomenon of study. Such review may be a part of a discrete or continuous chain of such evaluations.

Parameters of Review of Literature


The accomplishment of this task, involved in review, requires that (a) the reviewer properly understands the study that is to be reviewed. For this, the reviewer has to go through the study with an open mind; the study to be reviewed has to be approached independently, objectively and critically with a view to assess (a) the nature and scope of the study; (b) theoretical or policy frame in which the research question(s) has been formulated and examined. In case of policy related research, it is the policy frame, whereas an empirical problem of research requires the explanation of the context of the problem in order to determine its relevance; (c) method(s) or technique(s) of analysis; (d) nature and extant of the data base; and (e) finally, the important new findings that have been incorporated in the study. All these facets have to be evaluated in the light of the current state of knowledge on the one hand, and the extent to which knowledge has been advanced by these findings on the other.

While reviewing the literature/studies, the following aspects of the studies reviewed have to be kept in focus: a) if primary data are used, the reviewer has to evaluate whether the sample design, specially its size and representative character with reference to the important features of the sampled population, have been explained, and b) whether conclusions or inferences have been properly drawn and stated unambiguously. The reviewer has to understand the extent of research based findings incorporated in the study. The above criteria may be considered to be the basic parameters for the reviewing of literature.

Contents and Types of Literature

Literature, in the context of research studies and their review, comprises of i) Published Books, ii) Research Papers, iii) Articles, iv) Project Reports, v) Ph.D./M.Phil. Theses, and vi) Official and Un-official Records. This is an extremely vast and diverse menu. The un-published stuff is generally difficult to have an access to.

Reference Books
There are two types of books: text and reference books. Reference Books are based on research; these may be envisaged to be an expanded and magnified form of research papers. The reference books may also be divided into two groups: the books authored by one single author, and the edited books, authored by multiple authors. The single author reference books have one unified single theme. Naturally, such books may furnish a very extensive account of the given theme. Many aspects of the theme and knowledge and understanding about it might have been enriched by new, and hence, original knowledge contained in such books. Extension or modification of such knowledge may warrant further in-depth analysis and research. As against single author research books, the edited reference books are the compilation and collection of research studies (papers) written by different authors.

The responsibility of collection, coordination and editing rests with the editor(s). The editor takes the permission of the authors and publishers to use their studies in the compilation. These papers are then presented as chapters in different sections. But the authorship rests with the original authors. The edited books may or may not be characterized by the unity of the theme. The reference books are not conceived and designed to cover the part or whole of the syllabi prescribed for some Diploma or Degree program of any university or institute, though teachers may use these books both for teaching and research. These books are likely to be consulted largely by researchers. These books are characterized by all the features of research papers that will be elaborated later.

Text Books
As against the Reference Books, Text Books are basically the compilations from various sources. These compilations are, however, different from the compilations that the edited research books contain. The text-books use the material of other authors in a synthesized structure and specially designed format. Each chapter deals with a specific theme or topic. But the diverse material and views, in conformance or contradiction, are organized and integrated to portray the thematic unity. These books, however, include only such material as has become common scientific knowledge and which is supposed to be possessed by students for qualifying for given diploma or degree program of some university/institute.

A minimum of this common knowledge is warranted to be disseminated by the teachers and assimilated and absorbed by the students at a given level on a wide scale. Students are, therefore, expected to acquire this knowledge for qualifying for the award of diplomas / degrees or even certificates of various levels and types. Naturally, the text books are designed to cover the prescribed curricula for specific programs/courses of study. These text books are different from the books of popular reading such as travel accounts, biographies etc. on the one hand, and reference books on the other.

It may, however, be noted that the major part of the contents of even the text books must have emanated from research in the past. Slowly and gradually the same tend to emerge as the common knowledge, which then should be passed over to the successive generation of students. It may be interesting to know that Keynes theory became a part of post graduate syllabi only in early fifties. But now even the college and secondary graduates are expected to know Keynesian theory. Then, the continuous accumulation of new knowledge leads to the discarding of some elements of knowledge that might have been considered to be important in the past but which becomes obsolete, or irrelevant or which have been proved to be imperfect, imprecise or even incorrect by the subsequent development of knowledge and understanding.

For example, no one now subscribes to the view that the sun revolves round the earth. Similarly, Adam Smiths Cannons of Taxation and Ricardos Theory of Rent have now become obsolete. These have naturally no place in text books. The syllabi tend to be revised and updated periodically. Each revision leads to the deletion of the old and obsolete and incorporation of new advancement in knowledge. For example, one unified course in Advanced Economic Theory was prescribed for post graduate students till late sixties in India. Now Micro and Macro Economic Theory constitute two separate papers. Such revisions of syllabi automatically lead to the revision of the contents of the corresponding text books by their respective authors.

Articles
Articles are generally published in popular magazines and news papers, whereas research papers are published in professional journals and edited reference books. These are also presented to the seminars and conferences. Conference Proceedings will be the main source of those papers which remain un-published for one reason or the other. Articles, as distinguished from Research Papers, are based on opinions and compilations of views of others, which may or may not be supported adequately either by logic or sufficient empirical evidence or findings provided by scientific method of analysis. Articles are generally published in news papers, popular magazines and even specialized magazines.

India Today, Business World, Capital, Commerce, Economic Affairs, Financial Express, Economic Times are some examples of such publications. Swaminathan Ankleshwar Aiyar, Krishna Kumar, Bidwai, P. Chidambaram and many others regularly write such popular articles in news papers. Some journals of Business Schools may also include such articles on a variety of topics probably with a view to disseminate information contained in these articles on a wider scale. Obviously, articles may generally be descriptive in nature, though some authors, at times, may be analytical or reflective also.

Research Papers
Research papers are generally published in professional journals, edited books, and/or are included in conference/seminar proceedings. Research papers are invariably the output of research endeavors. Research papers are distinguished from articles by the following features: The research papers invariably use extensively one or more method(s) of data collection and data analysis; The papers are highly marked by logical consistency, conformity with the premises and assumptions; The research papers invariably incorporate the research findings of the particular investigation, which may furnish deeper under-standing and explanation of the phenomenon under investigation. These findings, more often than not, are in the nature of add on to the given state of knowledge;

The research papers mostly generate new knowledge, howsoever limited and whatever the extent of its contribution to the current knowledge. The papers are naturally characterized by the originality of the conception, innovative approach, and/or interpretation and explanation of the results that convey deeper meanings; The author of any research paper precisely delineates the theoretical, policy and/or empirical context and his/her findings have to keep this context as a reference point;

Often the researcher may portray his / her findings in a comparative framework to highlight his / her contribution to the existing literature; and
The assumptions, limitations of data, sample design, analytical tools and interpretation of the results are properly highlighted in order to provide an appropriate context and pointedly show the nature and extent of ones own contribution along with the limitations, if any, of ones own study.

Selection of Studies for Review


Research papers and reference books have to be carefully screened for review. Pieces for review have to be selected on the basis of i) topicality of the give aspect of the theme, ii) relevance and utility for ones own investigation, and iii) the representative nature of the studies selected for review as of all the studies of that genre. Reference books, research papers and other studies have to be chosen with a view to review the most representative study of the given group. For example, Dharam Narain, and Mathur and Ezekiel were the early pioneers who propounded the thesis (theses) about the marketed/marketable surplus of foodgrains. Whereas backward bending supply curve, and hence, the lower sales at higher prices was the common strand of these two studies, the assumption of fixity of cash requirements was the hallmark of theorization by Mathur and Ezekiel.

The studies inspired numerous empirical studies to verify the twin theses. Hence, any student undertaking research in this area will find it useful to undertake a comprehensive review of these two studies. In the review chapter, studies undertaken for testing and verification of these theses may just be referred and tied up in a sentence or two by highlighting their findings which may validate the thesis, or which may throw light on the empirical relevance in the given context. Among the later studies, T. N. Krishnans study, that attempted to show that Mathur-Ezekiel thesis was valid even if the assumption of fixity of cash requirements was relaxed, deserves a brief review.

Mathur-Prakash study of the impact of inventory of foodgrains on general prices may warrant an independent review because i) the study has developed a detailed mathematical model to prove that the signs of income and price elasticity of sales of foodgrains by farmers have the signs and magnitude predicted by Mathur-Ezekiel thesis, and ii) the inventory behaviour of Indian farmers holds the key to inflation in Indian economy. This is also demonstrated empirically. Besides these studies, the studies by Prakash, S. and Indu Bala Tripathi, and Prakash S. and Sushma which have i) furnished first ever empirical estimates of cash requirements of Haryana and Punjab farmers both in the pre and post green revolution periods to show that the cash requirements have been growing through time.

This finding refutes the validity of Mathur-Ezekiel assumption of fixity of cash requirements, and ii) growing cash requirements notwithstanding, the consumption-sales behaviour of Indian farmers had been in conformity with the prediction of MathurEzekiels hypothesis. These studies have also explicitly highlighted the positively sloped consumption curve of foodgrains for the farmers. These facets may qualify these studies for inclusion in review in a bit detailed form. This type of selectivity shall cover the major thrusts of the studies in this field. As against these studies, books by D. S. Tyagi and M. V. Nadkarni, that are largely empirical in nature, may be touched upon briefly.

This detailed illustration has been included to enable the readers to comprehend the thrust of the argument of selectivity approach in the choice of studies for review. It implies that atypical research studies have to be treated on a separate footing from the typical ones. These atypical studies may come as initial water-sheds.
Another example is that of unbalanced theory of growth of Hirshman (1957), which was an atypical study among the numerous studies of growth and development that abounded in fifties and sixties. Rasmusen furnished the basis of research for empirically testing the Hirshman theory by developing the formulae, based on Leontief static model, to calculate the backward and forward linkages. These then became the foundation for numerous empirical studies across the world.

Besides the atypical studies of the above type, if some work has been very extensively referred and reviewed by earlier scholars, for example, studies of supply response of crop area to prices by Raj Krishna and others, only an atypical study need be picked up for review. Extensively reviewed pieces of this genre may, however, be re-reviewed, if the i) investigator has advanced knowledge by incorporation of new elements in his / her study; and ii) the review is of crucial relevance for the question(s) of research of the reviewer himself / herself. Since the hypothesis about acreage response to prices of cereal crops has been modified and extended by Prakash, Buragohain and Sharma, it may probably deserve a separate review. As this study is atypical, whereas most other studies have followed the earlier leads, it may be reviewed, while other typical studies may be over looked.

Naturally, all studies neither need to be reviewed nor is it feasible to review all the studies, specially the empirical ones unless these are marked by atypicality. But the studies that are directly relevant and / or that will sharpen the focus of the findings of ones own investigation in a comparative or contrasting frame or supportive role may be put in the centre stage of the review. All the same, selectivity has to be the guiding principle in the choice of studies to be included in the chapter of review of literature. Besides, the time required for an in-depth and extensive review of studies may be used as a guiding constraint to limit the number of studies taken up for review.

Role and Functions of Review of Literature


Review of Literature performs multiple roles and discharges diverse functions in research. Review of literature helps a candidate in the conduct of his/her research in multiple ways. The importance of Review of Literature may be assessed by the following: The broad area of research can be identified by a candidate on the basis of his/her own distinct aptitude, interest, skills and knowledge of the given subject/discipline. One should try to avoid the selection of an area which may appear as drab, dreary/boring and/or heavy in relation to ones own interest, aptitude, knowledge and skills.

These facets vary from candidate to candidate. Some persons may find computing and/or mathematical/statistical formulations to be un-interesting and/or the skills involved in the same to be beyond their comprehension and understanding. Unless one is determined to overcome such limitations in the course of research, research may become burdensome. But this information about the nature of research in the given area may be gathered from the consultation of literature available in the given field of a subject. It will, therefore, be difficult to know whether the chosen subject conforms to a candidates inclination, interest, aptitude and skills and knowledge possessed by him / her without consulting literature.

Without the familiarity with the existing research findings in the field, one may not understand and appreciate the nature and scope of a subject and suitability of a topic for research, its scope and nature, his/her own aptitude and interest, and hence, the difficulties that one may encounter. Review facilitates acquisition of (i) awareness of the current state of knowledge, and (ii) additional knowledge, that is expected to be acquired by the research investigation of a candidate in a given area by way of extension of the frontiers of knowledge, the filling up of the knowledge gaps, and/or modification and/or extension of the current findings.

This consultation of literature may also indicate the knowledge gaps and the broad problems in a given field that warrant research. It is worth noting that the repeated research in any given area is prone to be imitative, or at the best, if it is empirical, it may be designed for the testing and verification of the established theory. The law of diminishing returns applies to the value, and hence, recognition of the importance of repetitive / imitative research also. From this view point, a totally unresearched or the least researched area has the potential of yielding better and higher recognition for the research findings of the candidates. But this aspect can be discovered by extensive consultation of literature. Even to know the current interests of the profession, one has to be familiar with the on going research for which one has to keep abreast of the current publications, specially those in the professional journals.

Once the broad area has been identified for research, consultation of literature in general and its critical evaluation in particular may enable the candidate (a) to select the precise problem of investigation in that area. The survey of literature familiarizes one what the predecessors and contemporaries have already done and how in the given area; (b) one acquires an understanding of the chinks and strengths of the work in the area, and more importantly, the gaps that have been left by the studies may become obvious; (c) one may also learn as to what aspects of the same problem may warrant further research. This assessment may enable the researcher to select the problem of investigation for his/her thesis with proper insights and understanding on the one hand, and delimit its scope by precisely formulating the topic of investigation to focus it on some specific aspect of the chosen problem on the other.

Review of literature facilities the identification of the gaps and limitations in the current knowledge. Naturally, all these gaps need not necessarily be worth filling, or of equal importance. Gaps may either be theoretical, methodological, factual or even policy or interpretation related. The nature and importance of the gap in knowledge left by others, that the researcher seeks to fill up, determines the nature and importance of his/her own investigation. Understanding of this aspect enables the researcher in explaining his / her research problem adequately and the importance of the given investigation may emerge from the explanation of the problem right at the inception of the study. Thus, a prior understanding of the nature and importance of ones research makes the rest of the task easy and enlightened. The knowledge of the contribution of others will help in defining ones own research problem precisely and formulate the research question(s) appropriately.

The readers also understand and appreciate the contribution made by a precisely defined and appropriately portrayed and presented study. Whether it is worth the while of the readers to invest their time and effort in reading the outcomes of the given research depends on this understanding and appreciation. Previous step should automatically help the candidate in defining the problem of his investigation precisely with a view to focus on one or some aspects rather than stating the topic ambiguously with very extensive or undefined scope. Let it be understood and appreciated that the delineation of the scope of research precisely and defining it narrowly are essential not only for focusing and concentrating accurately on the specifics of the problem of research but it is also important and necessary for delving deep to uncover not only what is obvious on the surface but also discern, detect and discover that lies much below the surface and circumference.

Not only the explicit but the implicit facets of the research problem also warrant investigation, and hence, revelation and highlighting. This aspect is often missed both by the research scholars and several guides/supervisors. Ambiguity in the defining of the problem and undefined or open-ended nature of the scope of investigation will not only make research unmanageable but it will also compromise the quality. For example, a Yemeni candidate approached BIMTECH with the following topic Human Resource Management in Banking Industry of Saudia Arabia and India A Comparative Study. He has also his synopsis ready, purported to have been prepared under the guidance of the Director-General of a sister institute.

Now, HRM is an extremely vast subject in its own right. In the first instance, HRM should not be confused either with Human Resource Planning, Human Resource Development, or Human Resource Utilization. HRM should obviously include HR utilization also. But utilization is pre-determined by (a) determination of size and structure of manpower, (b) institution of vacancies and detailed work-out of the profiles of each job, (c) translation of these profiles into the profiles required for the job performance and their translation into qualifications, skills and experience, (d) initiation and completion of the recruitment process which includes several facets and varied activities, (e) training, and (f) finally, deployment, and hence, utilization. Whether deployment is optimal or sub-optimal is a problem of another genre.

Now, will any candidate be able to investigate all these aspects of the problem of the level and pattern of deployment and the utilisation of human resources in the banking industry of two countries? Banking industry comprises of large number of banks of different types each of which performs numerous functions of highly diversified nature. Naturally, if one keeps the above in view, a comparison of HRM in banking industry of two countries shall be a gigantic task for an individual scholar. The data needs of the study shall almost be unmanageable. It would have been practically infeasible and unviable for the candidate to complete the study in an affordable time frame.

The level at which the current crop of post-graduates are left by

Indian educational system does not enable them even to know


what research is all about, leave apart the possession of knowledge and skills required to conduct the research. Most of

the candidates are not even equipped and endowed with the
knowledge and skills to select and appropriately define the research problem.

It is in the interest of the candidates to select a problem which they will find it possible to complete within a finite time period. For this, it is necessary that (i) the scope of investigation is precisely delimited in an extremely narrow range; (ii) data requirements, in case of an empirical study, are limited and manageable. In case, primary data shall be required, the population size may be an important consideration and it has to be anticipated whether the members of the population shall be responsive to furnish the requisite information to the investigator, which he/she will need for the study. In case, the investigation penetrates into the confidentiality zone of a corporate organisation, the building of information base will have an additional difficulty. Even such government organizations as collect information from the business houses periodically on a regular basis respect the confidentiality.

For example, C.S.O. in Annual Survey of Industries aggregates the data for companies across the states, if only one or two companies of an industry operate in a state. Then, the paucity of time may also play spoil-sport. For example, certain professionals, such as doctors and businessmen, may not be cooperative due to their busy schedule. Their reasons for non-cooperation may differ from one group of professionals to another group and even from person to person within a group. But this will complicate the task of data management. A PGDBM student had to spend more than three months in seeking appointments with HR managers of pharmaceutical companies in Delhi. Even then she could manage appointments hardly with seven respondents in three months. Both the scholar and supervisor(s) have to take care of these problems at the time of the choice of the topic for research; (v) candidates may also pick up an appropriate framework, techniques and methods for analysis on the basis of familiarity with the received knowledge, the potential inputs from the research guide and their own capability profile.

It is ideas that lead to action. Naturally, the broad portrayal of the theoretical framework of the problem or its policy or empirical context not only highlights the relevance and usefulness of a given research investigation but it also provides direction and imparts thrust to research effort. Focus on direction and thrust in research is an essential need in the long journey of research investigation, lest one should lose way and/or direction in the middle, since research can not be completed in a day or two or even a couple of months so far as research for Ph.D. / M. Phil. degree is concerned.

Finally, the candidate is enabled by the received knowledge to highlight the nature and importance of his / her own findings by pin-pointedly explaining the knowledge addition by his/her investigation. No investigation can ever address all the aspects of research at any time. Besides, knowledge progresses gradually, and to begin with, no new idea may seem earthshaking. But big structures are made brick by brick. Mortar and all bricks are important for the structure. It is, therefore, the portrayal of ones own piece of research, howsoever incongruent or small it may appear, that has to the focused on. This task can not be accomplished without a proper review of literature.

Parameters of Evaluation and Assessment of Studies


One can not assess and evaluate the work of others without an understanding of the procedure and rules of the game, called review of literature. The quality of outcome of research may, therefore, be examined in terms of well accepted norm and/or standard. The norm/standard may be resolved and decomposed into specific parameters. The following parameters may be the components of the decomposition of these rules of procedure, though the combinations may differ from candidate to candidate and these may also vary between the topics and subject (s).

While evaluating and reviewing any research paper or research based book, the following parameters / criteria may be kept in view: It is a well known dictum that simple is beautiful. This may apply to language as well, which is simply a medium of expressing ones views, opinions and emotions. Each word has a definite meaning though, at times, connotation may be provided by the context. The words have to be chosen carefully in order to convey the intended meanings with exactitude, clarity and precision. Besides, nothing has to be left un-stated, half stated or ambiguous. Simplicity of language and precision of expression in order to determine whether the author has left some part(s) vague and ambiguous may be used as a criterion to evaluate any study. The complex language and clichd expression may contribute neither to the proper communication of the ideas, and hence, understanding of the same by the readers, nor will it lead to the avoidance of infructous expressions. It may also compromise the quality of the thesis, and hence, the researchers contribution to knowledge.

The interpretation of the findings has to be fitted into the adopted framework of analysis. Proper explanation of the theoretical or policy framework of the study is an important parameter for the evaluation of any study. Inadequately explained framework of theory or policy or empirical background of a problem will compromise the logical felicity and consistency of explanation with the contextual framework. Conformity of the results with the contextual framework has to be highlighted, whereas the dissonance between these two shall warrant a deeper explanation. Whether the investigation has been appropriately related to the theoretical or the policy context, in which the problem of investigation has been portrayed and explained, has to be examined carefully. Contextual framework will also indicate the extent and direction in which the received knowledge has been advanced by a given investigation.

Relevance of the study in the current state of the knowledge or the problems and challenges under investigation will highlight the importance of the study. The relevance of the study has to be evaluated either with reference to the practical problems and challenges at the given point in time, or the theoretical, policy, and methodological gaps that have been filled up by the results of the study, or the objectives and hypotheses that have been set up for research at the outset of the study. The findings of any given research may be evaluated with reference to the coherence, congruence and consonance/dissonance between the adopted framework and objectives on the one hand, and concrete findings with reference to the existing state of knowledge about the topic of research on the other.

You might also like