教育元评估的理论与实践研究
摘要
本研究立足现实,审视了我国教育评估实践领域中面临的现实困境,分析了教育评估专业化发展过程中的瓶颈问题,试图探索一条能推进我国教育评估规范发展的路径——教育元评估。教育元评估的本质是依据教育评估的专业标准,对教育评估进行价值判断,教育元评估的目的是改善教育评估活动,提升教育评估质量,最大程度发挥教育评估功能。对教育元评估的重视是教育评估理论与实践走向成熟的重要标志。本研究对于促进教育评估理论体系的完善,指导教育评估实践领域的优化,将具有一定的开拓意义,同时也期望教育元评估的实证研究,能为教育评估学术界和实践者提供一个系统反思和理性提升的工具,并进一步推动教育评估迈向科学化、专业化和规范化的发展之路。
本研究从理论基础分析、制度层面借鉴和实证操作探索三个层次开展了相关研究。在理论基础分析部分,对“元”意识的哲学内涵进行了较为深入的阐释,明确了元评估是对评估本身的一种反思和总结,是更高一层次的批判和审视,是通过发挥分析的科学功能去推动教育评估理论自身的完善和发展。同时,从系统科学的控制论中寻找到反馈控制原理作为教育元评估的方法论基础,从而推演出教育元评估在整个教育评估复杂系统中不可替代的重要作用,体现了教育元评估在优化和改进教育评估活动中的实践价值。
在制度借鉴的研究部分,研究探讨了美国教育元评估的标准化发展历程和荷兰教育元评估的制度化形成特点,因为元评估的标准化是推进美国教育评估行业自律和教育评估专业化的重要途径,而荷兰高等教育元评估制度作为整个国家高等教育质量保障体系的一个重要组成部分,对改善和提升高等教育质量发挥了极其重要的作用。期望这些探究能为我国构建教育元评估制度,加强教育评估专业化发展产生重要的借鉴作用。
在最后的实证研究部分,采用Delphi法研制了一套符合我国地域文化特点和教育评估现状的教育元评估指标,作为实践教育元评估的工具,并通过个案分析,选取了上海市民办职业培训机构诚信等级评定进行元评估实证研究,从目标适切性、方案可行性、过程精确性和结果有效性四项基本要素的角度,对原评估的质量进行了评判,为原评估的委托方、结果使用者和评估专业机构提供了有益建议,也作为教育元评估指标的一次试测,提供了元评估的实践操作范本。
Surveying the difficulties in the practice of educational evaluation, and critical problem in the professional development of educational evaluation in China, the dissertation explores the appropriate solution to the reputation crisis of educational evaluation,Educational Meta-evaluation.The nature of educational meta-evaluation is to make value judgment of educational evaluation according to the professional standards of educational evaluation. The purpose of educational meta-evaluation is to improve educational evaluation, promote its quality and exert its function. The research of educational meta-evaluation marks the maturity of educational evaluation, both in theory and practice. The dissertation will play a key role in perfecting the theoretical system and optimizing the practice of educational evaluation. In the era when educational evaluation is flourishing in China, this research will surely present a powerful tool of systematic reflection and theoretical upgrade for the educational evaluation scholars and practitioners, promoting scientificalization, professionization and standardization of educational evaluation in China.
The research consists of three parts, which are theoretical analyses, system references and practical research. In the part of theoretical analyses, the dissertation makes a thorough illustration of the philosophical nature of "meta" and reveals that meta-evaluation is a reflection and review of evaluation itself, and a critique and inquiry of higher level, which perfects the theory of educational evaluation. The dissertation proceeds to explain that based on feedback control principle of Cybernetics, meta-evaluation has irreplaceable functions in the complex system of educational evaluation, and practical value in optimizing educational evaluation.
In the part of system references, the dissertation explores the standardization of educational meta-evaluation in America and systemization of higher educational meta-evaluation in Dutch. In America,the standardization of meta-evaluation is a critical approach to profession self-discipline and professionization of educational evaluation. Dutch meta-evaluation system is an important part of higher education quality assurance system. These researches have references value on constructing educational meta-evaluation system and strengthening the professionization of educational evaluation in China.
In the last part of the dissertation, the research adopts Delphi method and establishes a set of educational meta-evaluation index which fits Chinese national culture and state of its educational evaluation. The dissertation applies case study to carry out meta-evaluation of Private Professional Training Organization Trust Evaluation in Shanghai. The meta-evaluation index covers propriety of purpose, feasibility of program, accuracy of process and utility of result. The research evaluates the quality of original evaluation and offers some available advices to the clients, evaluation users and professional evaluation institutes.This case study is a pilot application of educational meta-evaluation index and also a practical model of meta-evaluation.
本研究从理论基础分析、制度层面借鉴和实证操作探索三个层次开展了相关研究。在理论基础分析部分,对“元”意识的哲学内涵进行了较为深入的阐释,明确了元评估是对评估本身的一种反思和总结,是更高一层次的批判和审视,是通过发挥分析的科学功能去推动教育评估理论自身的完善和发展。同时,从系统科学的控制论中寻找到反馈控制原理作为教育元评估的方法论基础,从而推演出教育元评估在整个教育评估复杂系统中不可替代的重要作用,体现了教育元评估在优化和改进教育评估活动中的实践价值。
在制度借鉴的研究部分,研究探讨了美国教育元评估的标准化发展历程和荷兰教育元评估的制度化形成特点,因为元评估的标准化是推进美国教育评估行业自律和教育评估专业化的重要途径,而荷兰高等教育元评估制度作为整个国家高等教育质量保障体系的一个重要组成部分,对改善和提升高等教育质量发挥了极其重要的作用。期望这些探究能为我国构建教育元评估制度,加强教育评估专业化发展产生重要的借鉴作用。
在最后的实证研究部分,采用Delphi法研制了一套符合我国地域文化特点和教育评估现状的教育元评估指标,作为实践教育元评估的工具,并通过个案分析,选取了上海市民办职业培训机构诚信等级评定进行元评估实证研究,从目标适切性、方案可行性、过程精确性和结果有效性四项基本要素的角度,对原评估的质量进行了评判,为原评估的委托方、结果使用者和评估专业机构提供了有益建议,也作为教育元评估指标的一次试测,提供了元评估的实践操作范本。
Surveying the difficulties in the practice of educational evaluation, and critical problem in the professional development of educational evaluation in China, the dissertation explores the appropriate solution to the reputation crisis of educational evaluation,Educational Meta-evaluation.The nature of educational meta-evaluation is to make value judgment of educational evaluation according to the professional standards of educational evaluation. The purpose of educational meta-evaluation is to improve educational evaluation, promote its quality and exert its function. The research of educational meta-evaluation marks the maturity of educational evaluation, both in theory and practice. The dissertation will play a key role in perfecting the theoretical system and optimizing the practice of educational evaluation. In the era when educational evaluation is flourishing in China, this research will surely present a powerful tool of systematic reflection and theoretical upgrade for the educational evaluation scholars and practitioners, promoting scientificalization, professionization and standardization of educational evaluation in China.
The research consists of three parts, which are theoretical analyses, system references and practical research. In the part of theoretical analyses, the dissertation makes a thorough illustration of the philosophical nature of "meta" and reveals that meta-evaluation is a reflection and review of evaluation itself, and a critique and inquiry of higher level, which perfects the theory of educational evaluation. The dissertation proceeds to explain that based on feedback control principle of Cybernetics, meta-evaluation has irreplaceable functions in the complex system of educational evaluation, and practical value in optimizing educational evaluation.
In the part of system references, the dissertation explores the standardization of educational meta-evaluation in America and systemization of higher educational meta-evaluation in Dutch. In America,the standardization of meta-evaluation is a critical approach to profession self-discipline and professionization of educational evaluation. Dutch meta-evaluation system is an important part of higher education quality assurance system. These researches have references value on constructing educational meta-evaluation system and strengthening the professionization of educational evaluation in China.
In the last part of the dissertation, the research adopts Delphi method and establishes a set of educational meta-evaluation index which fits Chinese national culture and state of its educational evaluation. The dissertation applies case study to carry out meta-evaluation of Private Professional Training Organization Trust Evaluation in Shanghai. The meta-evaluation index covers propriety of purpose, feasibility of program, accuracy of process and utility of result. The research evaluates the quality of original evaluation and offers some available advices to the clients, evaluation users and professional evaluation institutes.This case study is a pilot application of educational meta-evaluation index and also a practical model of meta-evaluation.
引文
1 吴启迪,中国高等教育评估体系的构建与完善,教育发展研究,2009年第3期,38-41
2 《教育部关于规范普通中小学校检查、评估工作的意见》(教督[2007]1号),引自http://www.chinaedu.edu.cn/e21sqlimg/html temple/2007-06-19/article 18512.htm
3 规范评估工作 提高评估质量——教育部召开高枝本科教学评估研讨会,《中国教育报》2008年4月12日第1版
1 转引自苏锦丽,展望我国教育评鉴专业之发展,国立台湾师范大学教育研究中心举办“教育评鉴回顾与展望”学术研讨会论文集,2004年,24-27
2Madaus, G.F.,Stufflebeam, D. L.,& Scriven, M.S.(1983) Program evaluation:A historical overview. In G.E Madaus et al. (eds.). Evaluation model:Viewpoints on educational and human services evaluation (pp.1-22).Boston:Kluwer Academic.
1 Fitzpartrick.J.L.,Sanders,J.R.,& Worthen,B.R.(2004) Program evaluation:Alternative approaches and practical guidelines(3rd ed.). (pp134-135).Boston/Allyn and Bacon:Pearson Education.
1 Stufflebeam, D. L. and Shinkfield,A.J. (2007) Evaluation Theory, Models,& Applications. (p647). San Francisco:CA. Jossey-Bass.
1 唐莹、瞿葆奎：元理论与元教育学引论,华东师范大学学报(教育科学版),1995年第1期,1-14
2 汪玲、方平、郭德俊：元认知的性质、结构与评定方法,心理学动态,1999年第1期,6-11
3 黑格尔：小逻辑,北京,商务印书馆,1980年版,第90页
4 瞿葆奎主编,陈玉琨著：教育学文集·教育评价学,北京,人民教育出版社,1999年版,第15页
1 Joint Committee on Standards for Educational Evaluation(1981) Standards for Evaluations of Educational Programs, Projects and Materials (p12) New York:McGraw-Hill
2 Walberg, H. J.& Haertel, G D. (eds.)(1990) The international encyclopedia of educational evaluation, (pp229-230).Oxford:Pergamon Press,
3 Stufflebeam,,D.L.& Shinkfield,A.J.(1985) Systematic Evaluation:A self-instruction guide to theory and practice. (pp68-76)Boston:Kluwer-Nijhoff.
4 Scriven, M.(1972).An introduction to meta-evaluation. In P. A. Taylor,& D. M.Cowley,(eds.).Readings in curriculum evaluation(pp84-86).Chicago:University of Chicago.
5 Stufflebeam, D. L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service No. ED090319)
1 Stufflebeam, D. L (1981)Metaevaluation:Concept, Standards, and Uses. In R. A. Berk (Eds.), Educational Evaluation Methodology:The State of The Art (pp146-163). Baltimore, MD:Johns Hopkins University
2 Orata, P. T.(1940) Evaluating Evaluation, Journal of Educational Research, volumn ⅩⅩⅩⅢ(9),641-646
3 Scriven,M. S.(1969).An introduction to meta-evaluation. Educational Products Report,2,36-38
1 Madaus,G.F.,Stufflebeam,D. L..& Scriven,M.S.(1983).Program Evaluation:A Historical Overview. In Madaus, G.F., Scriven, M.&.Stufflebeam, D. L. (Eds.). Evaluation Models.(pp3-22).Hingham: Kluwe-Nijhoff.
2 游家政：国民小学后设评鉴标准之研究,国立台湾师范大学教育研究所博士论文,1994年
1 Scriven,M. S.(1969).An introduction to meta-evaluation. Educational Products Report,2,36-38
2 Cook, T. D.(1974). The Potential and Limitations of Secondary Evaluation, In M. W. Apple, M.J.Subkoviak,& H.S.Lufler, Jr.(Eds.).Educational Evaluation:Analysis and Responsibility (pp.155-235). Berkeley, CA:
MrCutrhan.
3 Stufflebeam, D. L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service, No. ED090319).
4 Stufflebeam, D. L.(1981)Metaevaluation:Concept, Standards, and Uses. In R. A. Berk (Eds.), Educational
Evaluation Methodology:The State of The Art (pp 146-163). Baltimore, MD:Johns Hopkins University
5 Cook, T. D.,& Gruder, C. L.(1978).Metaevaluation Research. Evaluation Quarterly,2(1)
6 Nilsson,N.& Hogben, D.(1983) Metaevaluation, in E. R. House (Ed.) Philosophy of Evaluation, (pp313-327). San Francisco:Jossey-Bass
7 Brinkerhoff, B. O.,Brethower, D. M.,Hluchyj,T.& Nowakowski, J. R.(1986) Program Evaluation:A
Practition's Guide for Trainers and Educators. (p56). Boston:Kluwer-Nijhoff
5 Schwandt, T. A.,& Halpern, E. S.(1988). Linking Auditing and Metaevaluation, (p83). Newbury Park, CA: SAGE Publications
9 Aspinwall, K.,Simkins, T, Wilkinson, J. F.,& McAnley, M. J.(1992) Managing Evaluation in Education. (p38) New York:Routledge
1 The Joint Committee on Standards for Educational Evaluation(1981)Standards for Evaluation of Educational Programs, Projects, and Materials.(p18) New York:McGraw-Hill.
2 Evaluation Research Society Standards Committee(1982) Evaluation research society standards for program evaluation, New Directions for Program Evaluation,15:7-19
1 Nyirenda, Stanley,(1994) Assessing Highly Accomplished Teaching:Developing a Metaevaluation Criteria Framework for Performance-Assessment Systems for National Certification of Teachers, Journal of Personnel Evaluation in Education,8(3),313-327
2 Finn, C. E., Stevens, F. I., Stufflebeam, D. L.,& Walberg, H. J.(1997) A Meta-evaluation, In H. Miller (Ed.), The New York City public schools integrated learning systems project. International Journal of Educational Research,27,159-174
3 Sanders, J. R,(1999) Metaevaluation of'the effectiveness of comprehensive, case management interventions: Evidence from the national evaluation of the comprehensive child development program',American Journal of Evaluation,20(3),577-582
4 Marlene, M.Laubliloud, (2004) Setting Standards and Providing Guidelines:The Means toward What End? Evaluation,10(2),237-245
5 转引自苏锦丽,黄曙东：世界重要国家评鉴专业标准与原则发展对我国之启示,高教评鉴,2007年第1期,51-82
6 Naccarella, L., et al. (2007) Building evaluation capacity:Definitional and practical implications from an Australian case study, Evaluation Program Planning,30(3),231-236
1 Patel, M. (2002) A meta-evaluation, or quality assessment, of the evaluations in this issue, based on the African Evaluation Guidelines:2002, Evaluation and Program Planning 25,329-332
2 Jan Kolkwijk,(1992) The Netherlands:The Inspectorate Perspective, Quality Assurance in Quality Assurance in Higher Education. Proceedings of an International Conference, ED371651.Hong Kong, Ed. Alma Craft, The Farmer Press
3 严芳：荷兰高等教育外部质量保障新机制探析,高教发展与评估,2006年第1期,55-59
4 Stufflebeam, D. L. (2000) The methodology of metaevaluation. In D. L. Stufflebeam, G F. Madaus & T.Kellaghan, Evaluation models:Viewpoint on educational and human services evaluation. (2nd ed.), (pp458-471).Boston:Kluwer
5 Hanssen, C. E. (2008) Concurrent Meta-Evaluation:A Critique, American Journal of Evaluation,29(4),572-582
6 Russon, C. (2000) The Program Evaluation Standards in International Settings, Kalamazoo:Western Michigan University Evaluation Center
7 徐枞巍,许建钺：元评估及教育评估信度与效度的扩展模型,中国高等教育评估,1997年第2期,2-4
8 方鸿琴：国外教育元评估的分析及对我国的启示,江苏高教,2004年第1期,92-95
1 史耀芳：略论教育评价中的元评价,教育理论与实践,1991年第5期,42-44
2 侯光文：试论教育评价元评价,教育理论与实践,1998年第4期,23-26
3 许茂祖：论高等教育评估中的再评估,中国高等教育评估,2000年第4期,27-31
4 顾永才：教育评价活动的再评价,教育研究,1990年第4期,71-73
5 陈玉琨：中国高等教育评论,广东：广东高等教育出版社,1993年版,46-61
6 周志刚：对再评估的探讨：值得重视和研究的问题,1996年国际教育评估与质量保证会议交流材料
7 陈玉琨、李如海：我国教育评价的发展的世纪回顾与未来展望,华东师范大学学报(教育科学版),2000年第1期,1-12
8 高洁、蔡敏：美国教育评价的元评价及其启示,世界教育信息,2007年第6期,21-24
9 王云峰、曲霏：基于元评估理论的学科评估应用研究,科研管理,2009年第1期,143-148
10 吴建南、白波：评估政府绩效评估：元评估方法的探索性应用,行政论坛,2009年第6期,32-37
11 王雁、章仁彪：教育元评估的理念与标准辫析,中国高等教育评估,2009年第1期,41-44
12 张守臣：论本科教学工作水平评估的元评估问题,中国高教研究,2009年第3期,29-30
13 熊光慈：高等教育元评估——高等教育评估的偏差研究,河南,郑州大学出版社,2009年版
1 孙锐、王战军、周学军：浅议高等教育评估机构的社会职能及其实现,中国高教研究,2001年第11期：38-39
2 顾明远：高等教育评估中几个值得探讨的问题,高教发展与评估,2006年第3期,1-3
3 冯晖：教育评价中的敏感性问题研究,华东师范大学学报(教育科学版),2007年第2期,37-41
4 杨晓江：试论我国高等教育评估制度的建立,云南教育,2002年第24期：69-73
5 国防科技大学研究生院编著：教育评估理论与方法及在研究生教育评估中的应用,北京,国防科技大学出版社,2004年版
6 徐明欣、高斌、李瑞年、鞠传进：元评估在学校体育评估实践中应用的研究,青岛大学学报,2000年第4期,74-80
7 贺祖斌：高等教育评价的元评价及其量化分析模型,广西民族学院学报(哲学社会科学版),2001年第4期,123-126
8 钱存阳、李丹青、潘岚：课堂教学质量评价元评价中的效度和信度分析,中国计量学院学报,2004年第2期,164-167
威廉·维尔斯曼著,袁振国主译：教育研究方法导论,北京,教育科学出版社,1997年版,第17-21页
1 亚里士多德著,关寿彭译：形而上学,北京,商务印书馆,1959年版,第79页
1 (美)加来道雄著,晓颖译：不可思议的物理,上海,上海科学技术文献出版社,2009年版,第5页
2 (美)A·P·马蒂尼奇编：《语言哲学》,北京,商务印书馆,1998年版,第91页
3 (英)罗伊·索伦森著,贾红雨译：悖论简史：哲学和心灵的迷宫,北京,北京大学出版社,2007年版,第10页
1 Nelson T O.,(1996) Consciousness and metacognition, American Psychologist,51(2):102-116
2 刘森林：元语用论概述,解放军外国语学院学报,2001年第4期,6-10
1 唐莹著：元教育学,北京,人民教育出版社,2002年版,第34页
2 张青松：源态理论、原态理论与元态理论——广义元理论研究之一,理论探讨,2005年第3期,92-94
1 李振伦：元理论与元哲学,河北学刊,1996年第6期,27-31
2 唐莹,瞿葆奎：元理论与元教育学引论,华东师范大学学报(教育科学版)1995年第1期,1-14
1 唐莹：元教育学——西方教育学认识论剪影(上),教育研究,2001年第2期,11-21
2 焦建利：教育技术学元研究论纲,电化教育研究,2004年第4期,8-13
3 Scriven, M.(1972) An introduction to meta-evaluation. In P. A. Taylor,& D. M.Cowley, (eds.). Readings in curriculum evaluation(pp.84-86).Chicago:University of Chicago.
1 Stufflebeam, D. L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service No. ED090319)
2 许国志、顾基发、车宏安编：系统科学,上海,上海科技教育出版社,2000年版,第1页
3 冯·贝塔朗菲著,林康义、魏宏森译：一般系统论：基础、发展和应用,北京,清华大学出版社,1987年版,第64-70页
1 (美)美国国家研究理事会,戢守志等译：美国国家科学教育标准,上海,科学技术文献出版社,1999年版,第140-141页
1 N·维纳著,郝季仁译：控制论,北京,北京大学出版社,2007年版,第3-8页
1 邵光远,张纪川编著：系统科学入门,北京,知识出版社,1990年版,第61-65页
2 李金松编著：系统论、信息论、控制论与教育改革,湖北,湖北教育出版社,1989年版,第133-136页
1 查有梁著：系统科学与教育,北京,人民教育出版社,1993年版,第10页
1 Scriven, M.S.(1969). An introduction to meta-evaluation. Educational Products Report,2,36-38
2 Scriven, M(1981).Evaluation Thesaurus. (pp43-45).CA:Edge Press.
3 Cook,T.D.(1974). The Potential and Limitations of Secondary Evaluation, In M.W. Apple, M.J.Subkoviak,& H.S.Lufler, Jr.(Eds.).Educational Evaluation:Analysis and Responsibility (pp155-235). Berkeley, CA: MrCutrhan.
1 Cook, T.D.,& Gruder, C. L.(1978). Metaevaluation Research. Evaluation Quarterly,2(1),5-51
2 Stufflebeam, D. L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service No. ED090319)
1 Stufflebeam, D. L.(1981)Metaevaluation:Concept, Standards, and Uses. In R. A. Berk (Eds.), Educational Evaluation Methodology:The State of The Art (pp146-163). Baltimore, MD:Johns Hopkins University
2 Nilsson,N.& Hogben, D.(1983) Metaevaluation, in E. R. House (Ed.)Philosophy of Evaluation, (pp313-327). San Francisco:Jossey-Bass
3 Schwandt, T. A.,& Halpern, E. S.(1988). Linking Auditing and Metaevaluation, (p83). Newbury Park, CA: SAGE Publications
4 Aspinwall, K.,Simkins,T,Wilkinson, J. F.,& McAnley, M.J.(1992) Managing Evaluation in Education. (p38). New York:Routledge
5 Stufflebeam, D. L. (2001)The Metaevaluation Imperative, American Journal of Evaluation,22(2),183-209
6 陈玉琨：教育评价学,北京,人民教育出版社,1999年版,第8页
1 Scriven, M.(1974). Evaluation perspectives and procedure, In W. J. Popham (Ed.)Evaluation in education: current applications, (pp3-33), Berkeley, CA:McCutchen.
2 Cook, T.D.(1974) The Potential and Limitations of Secondary Evaluation. In M. W. Apple, M..J. Subkoviak,& H.S.Lufler, Jr. (Eds.).Educational Evaluation:Analysis and Responsibility (pp155-235). Berkeley, CA: MrCutrhan
3 Smith, N. L.(1981)Criticism and Meta-Evaluation. In N. L. Smith (Ed.) New Techniques for Evaluation (pp266-273) Newbury Park, CA:SAGE Publications.
4 Cook, T. D.,& Strawr, R. B.(1990) Meta-evaluation. In H. J. Walberg & G.D. Haertel (Eds.)The International Encyclopedia of Educational Evaluation (pp58-61).New York:Pergamon
5 Stufflebeam and Shinkfield (2007). Evaluation Theory, Models,& Applications. (p650).San Francisco:CA. Jossey-Bass
1 Brinkerhoff, B.O.,Brethower, D. M.,Hluchyj,T.& Nowakowski, J. R.(1986) Program Evaluation:A Practition's Guide for Trainers and Educators. (p56). Boston:Kluwer-Nijhoff
1 Cook, T.D.& Gruder, C.(1978) Metaevaluation research, Evaluation quality,2(1),5-51
1转引自Madaus, G F.,Scriven M.,& Stufflebeam, D. L.(1983) Evaluation Models:Viewpoints on Educational and Human Service. (pp138-140). Klaswer N-sjhoff Publishing
1 The draft of program evaluation standards, From:http://www.wmich.edu/evalctr/jc/
1 Evaluation Research Society(1982) Standards for program evaluation, New Directions for Program Evaluation, 15,7-19
1 Worthen,B. S..(1974)A Look at the Mosaic of Educational Evaluation and Accountability,from http://www.eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/36/dd/e0.pdf
1 Schwandt, T. A.,& Halpern, E. S.(1988). Linking Auditing and Metaevaluation, (p34). Newbury Park, CA: SAGE Publications
2 转引自Keun-bok Kang & Chan-goo Yi (2000, May). A design of the metaevaluation model. Poster session presented at the annual meeting of the Canadian Evaluation Society, Montreal, Canada
3 Keun-bok Kang & Chan-goo Yi (2000, May).A design of the metaevaluation model. Poster session presented at the annual meeting of the Canadian Evaluation Society, Montreal, Canada
1 Stufflebeam, D. L. (2004) A Note on the Purposes, Development, and Applicability of the Joint Committee Evaluation Standards,American Journal of Evaluation,25(1),99-102
1 Stufflebeam and Shinkfield (2007). Evaluation Theory,Models,& Applications. (p653). San Francisco:CA. Jossey-Bass
2 Madaus, G.F.,Stufflebeam, D. L.,& Scriven, M. S.(1983) Program evaluation:A historical overview. In G F. Madaus et al. (eds.).Evaluation model:Viewpoints on educational and human services evaluation (pp.1-22).Boston:Kluwer Academic.
1 Fitzpartrick,J.L.,Sanders,J.R.,& Worthen,B.R.(2004) Program evaluation:Alternative approaches and practical guidelines(3rd ed.). (pp134-135).Boston/Allyn and Bacon:Pearson Education.
2 转引自苏锦丽,展望我国教育评鉴专业之发展,国立台湾师范大学教育研究中心举办“教育评鉴回顾与展望”学术研讨会论文集,2004年,24-277
3 谭福有,标准和标准化的概念,信息技术与标准化,2005年第3期,56-57
1 梁燕君,发达国家标准体系的特色与启示,大众标准化,2005年第5期,24-26
1 Joint Committee on Standards for Educational Evaluation.(1994). The program evaluation standards (2nd ed.). (p1)Thousand Oaks, CA:Sage.
2 Joint Committee on Standards for Educational Evaluation(1981)Standards for Evaluations of Educational Programs, Projects and Materials,(p1)New York:McGraw-Hill
1 Donald B.Yarbrough, Lyn M.Shulha, Flora Caruthers (2004) Background and History of the Joint Committee's Program Evaluation Standards, New Directions for Evaluation, No.104, Wiley Periodicals, Inc., pp15-30
2 Sanders, J. R.,(1994) The Process of Developing National Standards That Meet ANSI Guidelines, Journal of Experimental Education,63(1),5-12
1 Thompson, B. (2004) The revised program evaluation standards and their correlation with the evaluation use literature, Journal of Experimental Education,63(1),54-82
1 Operating Procedures for the Development and Approval of Standards of the Joint Committee on Standards for Educational Evaluation,2006, from:http://www.icsee.org/wp-content/uploads/2009/09/OperProc.pdf
1 Chatterji, M.,(2005) Applying the Joint Committee's 1994 Standards in International Contexts:A Case Study of Education Evaluations in Bangladesh, Teachers College Record Volume 107, Number 10, October 2005, pp2372-2400, Teachers College, Columbia University
2 Uusikyla, Petri,& Virtanen, Petri (2000) Meta-Evaluation as a Tool for Learning:A Case Study of the European Structural Fund Evaluations in Finland, Evaluation,6(1),50-65
3 American Evaluation Association, Guiding Principles for Evaluators(revision), July 2004, from: http://www.eval.org/Publications/aea06.GPBrochure.pdf
1 张艳敏,梁东荣：荷兰高等教育质量保证制度的发展现状探析及其启示,高等教育研究,2006年第3期,1-5
2国家行政学院编译：《西方国家行政改革述评》,北京,国家行政学院出版社,1998年版第31页
1 Hood, C.(1991) A Public management for all seasons? Public Administration,69(1),3-19
1 (荷兰)弗兰斯·F·范富格特主编,王承绪等译,国际高等教育政策比较研究,浙江,浙江教育出版社,2001年版第253页
2 De weert, Egbert & Boezerooy, Patra (2007) Higher Education in the Netherlands. (pp13). Uniersity of Twente: CHEPS, from:http://www.utwente.nl/cheps/research/higher_education_monitor/2007countryreportnl.pdf
1 Karl Dittrich and Leendert Klaassen (2007) The accreditation system in The Netherlands and Flanders In Alessandro Cavalli (eds.) Quality Assessment for Higher Education, (pp115-125)Portland Press Ltd.
2 Quality assurance in higher education in the Netherlands and Flanders, Court of Audit of Belgium-Netherlands, 4 September,2008, p9
1 Kalkwijk, J.(1992) The Netherlands:The Inspectorate Perspective. In:Alma Craft(Eds.) Quality assurance in higher education:proceedings of an international Conference, (pp97-107), The Falmer Press.
1 Bresters, D. W.& Kalkwijk, J. P., The Role of the Inspectorate of Higher Education, In Goedegebuure, L.C.J. Maassen, P.A.M.& Westerheijden, D.F. (Eds.) Peer review and performance indicators:Quality assessment in British and Dutch higher education. (pp456-464)Utrecht:Lemma BV.
2 Jeliazkova, M.& Westerheijden, D.F. (2004) The Netherlands:A Leader in Quality Assurance Follows the Accreditation Trend, In:Schwarz, S. and Westerheijden, D.F. (eds.) Accreditation and Evaluation in the European Higher Education Area, (pp323-345) Kluwer Academic Publishers
1 Maassen, P. A. M.(1998) Quality Assurance in the Netherlands, New Directions for Institutional Research,99, 19-28, Jossey-Bass Publishers
2 Karl Dittrich and Leendert Klaassen (2007) The accreditation system in The Netherlands and Flanders In Alessandro Cavalli (eds.) Quality Assessment for Higher Education, (pp115-125)Portland Press Ltd.
1陶西平：教育评价辞典,北京,北京师范大学出版社,1998年版,第112页
2 Bottani, N.,& Tuijnman, A.(1994).The Design of indicators systems. In Tuijnman, A.C. and Postlethwaite, T.N. (eas.) Monitonng the Standards of Education. (pp47-77) Trowbridge:Redwood Books.
1 Joint Committee on Standards for Educational Evaluation.(1994). The program evaluation standards (2nd ed.). (p3) Thousand Oaks, CA:Sage.
1 王致和主编：高等学校教育评估,北京,北京师范大学出版社,1995年版第62页
1 刘淑兰：教育评估和督导,上海,华东师范大学出版社,2000年版,第73页
2 Linstone, H. A. and Turoff, M.,(Eds.)(1975) The Delphi Method:Techniques and applications. (p68) From: http://www.is.njit.edu/pubs/delphibook/chl.html
1 Dalkey, N.(1969) The Delphi method:An experimental study of group opinion.(p3)CA:Rand.
1 Stufflebeam, D.I.(1982) A Next Step:Discussion to Consider Unifying the ERS and Joint Committee Standards, In P. H. Rossi(Eds.)Standards for Evaluation Practice, pp30-31
1 中国的职业培训体系,中华人民共和国人力资源和社会保障部网站,from；http://wl.mohrss.gov.cn/gb/ywzn/2005-12/05/content_96561.htm
2 上海市劳动和社会保障局关于修改《本市民办职业培训机构审批和管理暂行办法》的通知(沪劳保技发[2006]23号)
1 仇立平：社会研究方法,重庆,重庆大学出版社,2008年版,第240-244页
1 陶西平：教育评价辞典,北京,北京师范大学出版社,1998年版第85页
1 吴启迪,中国高等教育评估体系的构建与完善,教育发展研究,2009年第3期,38-41
1 (美)曼昆著,梁小民译：经济学原理(第三版)(下册),北京：机械工业出版社,2003年版,第78页
[1]别敦荣：论高等教育评估的功能,高等教育研究,2002年第6期,34-38
[2]别敦荣：论高等教育评估的基本特征,辽宁教育研究,2004年第4期,14-16
[3]邵光远、张纪川编著：系统科学入门,北京,知识出版社,1990年版
[4]陈玉琨：中国高等教育评论,广东：广东高等教育出版社,1993年版
[5]陈玉琨、李如海：我国教育评价的发展的世纪回顾与未来展望,华东师范大学学报(教育科学版),2000年第1期,1-12
[6]方鸿琴：国外教育元评估的分析及对我国的启示,江苏高教,2004年第1期,92-95
[7]冯·贝塔朗菲著,林康义、魏宏森译：一般系统论：基础、发展和应用,北京,清华大学出版社,1987年版
[8]冯晖：教育评价中的敏感性问题研究,华东师范大学学报(教育科学版),2007年第2期,37-41
[9]弗兰斯·F·范富格特主编,王承绪等译,国际高等教育政策比较研究,浙江,浙江教育出版社,2001年版
[10]高洁、蔡敏：美国教育评价的元评价及其启示,世界教育信息,2007年第6期,21-24
[11]顾明远：高等教育评估中几个值得探讨的问题,高教发展与评估,2006年第3期,1-3
[12]顾永才：教育评价活动的再评价,教育研究,1990年第4期,71-73
[13]规范评估工作提高评估质量——教育部召开高校本科教学评估研讨会,《中国教育报》2008年4月12日第1版
[14]国防科技大学研究生院编著：教育评估理论与方法及在研究生教育评估中的应用,北京,国防科技大学出版社,2004年版
[15]国家行政学院编译：《西方国家行政改革述评》,北京,国家行政学院出版社,1998年版
[16]教育部,《教育部关于规范普通中小学校检查、评估工作的意见》(教督[2007]1号),引自http://www.chinaedu.edu.cn/e21sqlimg/html_temple/2007-06-19/article_18512.ht m
[17]贺祖斌：高等教育评价的元评价及其量化分析模型,广西民族学院学报(哲学社会科学版),2001年第4期,123-126
[18]黑格尔：小逻辑,北京,商务印书馆,1980年版
[19]侯光文：试论教育评价元评价,教育理论与实践,1998年第4期,23-26
[20]黄光扬：教育测量与评价,上海,华东师范大学出版社,2002年版
[21]加来道雄著,晓颖译：不可思议的物理,上海,上海科学技术文献出版社,2009年版
[22]焦建利：教育技术学元研究论纲,电化教育研究,2004年第4期,8-13
[23]金娣、王刚：教育评价与测量,北京：教育科学出版社,2002年版
[24]李金松编著：系统论、信息论、控制论与教育改革,湖北,湖北教育出版社,1989年版
[25]李振伦：元理论与元哲学,河北学刊,1996年第6期,27-31
[26]梁燕君：发达国家标准体系的特色与启示,大众标准化,2005年第5期,24-26
[27]林正范,贾群生：多元高等教育评价主体价值取向比较研究,清华大学教育研究,1999年第3期：36-40
[28]林正范,贾群生：高等教育质量概念探析,高等教育研究,1999年第4期：61-64
[29]刘军山、孟万金：关于高等教育评价指标体系质量的探讨,江苏高教,1999年第6期：11-13
[30]刘军山、徐枞巍：高等教育评价指标体系质量问题的理论探讨,北京航空航天大学学报(社会科学版),2000年第1期：57-59
[31]刘森林：元语用论概述,解放军外国语学院学报,2001年第4期,6-10
[32]刘淑兰：教育评估和督导,上海,华东师范大学出版社,2000年版
[33]刘志军：教育评价的反思与建构,教育研究,2004年第2期：59-64
[34]罗伊·索伦森著,贾红雨译：悖论简史：哲学和心灵的迷宫,北京,北京大学出版社,2007年版
[35]马蒂尼奇编,牟博等译,：《语言哲学》,北京,商务印书馆,1998年版
[36]曼昆著,梁小民译：经济学原理(第三版)(下册),北京：机械工业出版社,2005年版
[37]美国国家研究理事会,戢守志等译：美国国家科学教育标准,上海,科学技术文献出版社,1999年版
[38]钱存阳、李丹青、潘岚：课堂教学质量评价元评价中的效度和信度分析,中国计量学院学报,2004年第2期,164-167
[39]仇立平：社会研究方法,重庆,重庆大学出版社,2008年版
[40]瞿葆奎主编,陈玉琨著：教育学文集·教育评价学,北京,人民教育出版社,1999年版
[41]史耀芳：略论教育评价中的元评价,教育理论与实践,1991年第5期,42-44
[42]史耀芳：教育评价新策略——谈谈国外有关教育评价中的元评价研究,外国教育资料,1994年第3期：64-68
[43]苏锦丽：大学学科评鉴试办计划成效评估之研究,台北,师大书苑,1995年版
[44]苏锦丽：展望我国教育评鉴专业之发展,国立台湾师范大学教育研究中心举办“教育评鉴回顾与展望”学术研讨会论文集,2004年,24-27
[45]苏锦丽,黄曙东：世界重要国家评鉴专业标准与原则发展对我国之启示,高教评鉴,2007年第1期,51-82
[46]孙锐、王战军、周学军：浅议高等教育评估机构的社会职能及其实现,中国高教研究,2001年第11期：38-39
[47]谭福有,标准和标准化的概念,信息技术与标准化,2005年第3期,56-57
[48]唐莹：元教育学,北京,人民教育出版社,2002年版
[49]唐莹：元教育学——西方教育学认识论剪影(上),教育研究,2001年第2期,11-21
[50]唐莹、瞿葆奎：元理论与元教育学引论,华东师范大学学报(教育科学版),1995年第1期,1-14
[51]陶西平：教育评价辞典,北京,北京师范大学出版社,1998年版
[52]汪玲、方平、郭德俊：元认知的性质、结构与评定方法,心理学动态,1999年第1期,6-11
[53]王孝玲：教育测量(修订版),上海,华东师范大学出版社,2005年版
[54]王雁、章仁彪：教育元评估的理念与标准辫析,中国高等教育评估,2009年第1期,41-44
[55]王云峰、曲霏：基于元评估理论的学科评估应用研究,科研管理,2009年第1期,143-148
[56]王致和主编：高等学校教育评估,北京,北京师范大学出版社,1995年版
[57]王致和,季靖：我国高等教育评估制度建设回顾与展望,天津大学学报(社会科学版),1999年第3期：82-85
[58]王战军,孙锐：我国高等教育评估制度演进趋势探析,高等教育研究,2000年第6期：78-81
[59]威廉·维尔斯曼著,袁振国主译：教育研究方法导论,北京,教育科学出版社,1997年版
[60]维纳著,郝季仁译：控制论,北京,北京大学出版社,2007年版
[61]吴建南、白波：评估政府绩效评估：元评估方法的探索性应用,行政论坛,2009年第6期,32-37
[62]吴启迪,中国高等教育评估体系的构建与完善,教育发展研究,2009年第3期,38-41
[63]熊光慈：高等教育元评估——高等教育评估的偏差研究,河南,郑州大学出版社,2009年版
[64]夏天阳：各国高等教育评估,上海,上海科学技术文献出版社,1997年版
[65]徐景武：高等教育评估中的政府行为模式探析,江苏高教,2002年第3期,59-61／88
[66]徐明欣、高斌、李瑞年、鞠传进：元评估在学校体育评估实践中应用的研究,青岛大学学报,2000年第4期,74-80
[67]徐枞巍,许建钺：元评估及教育评估信度与效度的扩展模型,中国高等教育评估,1997年第2期,2-4
[68]许茂祖：论高等教育评估中的再评估,中国高等教育评估,2000年第4期, 27-31
[69]许国志、顾基发、车宏安编：系统科学,上海,上海科技教育出版社,2000年版
[70]荀振芳：高等教育评价的教育性视角,高等教育研究,2004年第2期：29-32
[71]亚里士多德著,关寿彭译：形而上学,北京,商务印书馆,1959年版
[72]严芳：荷兰高等教育外部质量保障新机制探析,高教发展与评估,2006年第1期,55-59
[73]杨晓江：教育评估的科学性与科学的教育评估,教育研究,2000年第8期：33-36＼75
[74]杨晓江：试论我国高等教育评估制度的建立,云南教育,2002年第24期：69-73
[75]叶国珍,杨晓江：如何看待我国高等教育评估质量,高教发展与评估,2005年第1期：47-50
[76]约翰·布伦南,特拉·沙赫著,陆爱华等译,高等教育质量管理：一个关于高等院校评估和改革的国际性观点,上海,华东师范大学出版社,2005年版
[77]查有梁著：系统科学与教育,北京,人民教育出版社,1993年版
[78]张民选：关于高等教育认证机制的研究,教育研究,2005年第2期,37-44
[79]张青松：源态理论、原态理论与元态理论——广义元理论研究之一,理论探讨,2005年第3期,92-94
[80]张守臣：论本科教学工作水平评估的元评估问题,中国高教研究,2009年第3期,29-30
[81]张艳敏,梁东荣：荷兰高等教育质量保证制度的发展现状探析及其启示,高等教育研究,2006年第3期,1-5
[82]张远增：高等教育评价方法研究,上海,复旦大学出版社,2002年版
[83]赵康,专业、专业属性及判断成熟专业的六条标准——一个社会学角度的分析,社会学研究,2000年第5期,30-39
[84]周庚渊：对评估的评估——美国对高教鉴定团体的认证,技术经济与管理研究,2005年第2期,54
[85]周志刚：对再评估的探讨：值得重视和研究的问题,1996年国际教育评估与质量保证会议交流材料
[86]鲍艳利：我国高等教育评估后评估内容与方法研究,河海大学硕士论文,2006年
[87]冯晖：元评价方法及其在高等教育评估中的应用研究,上海交通大学博士论文,2007年
[88]赖志峰：台北市幼稚园后设评鉴之研究,国立政治大学教育研究所硕士论文,1997年
[89]林劭仁：我国高级中学元评估指标之研究,国立政治大学教育研究所博士论 文,2001年
[90]刘凯：评价的合理性研究,华中科技大学硕士论文,2003年
[91]穆慧仪：国民中学后设评鉴之研究,国立台北师范学院硕士论文,2003年
[92]彭平根：评价中心的测评有效性及其影响因素的实证研究,华东师范大学博士论文,2003年
[93]曲霏：高等教育项目元评估的理论和实践研究,河北工业大学硕士论文,2007年
[94]王向红：我国高等教育评估质量保证研究,华中科技大学博士论文,2007年
[95]杨滨辉：我国高校内部教学评估体系的元评估研究,黑龙江大学硕士论文,2009年
[96]游家政：国民小学后设评鉴标准之研究,国立台湾师范大学教育研究所博士论文,1994年
[97]曾淑惠：我国专科学校后设评鉴之研究,国立台湾师范大学教育研究所博士论文,1996年
[98]张释心,桃园县私立幼稚园后设评鉴之研究,中原大学教育研究所硕士论文,2006年
[99]American Evaluation Association, Guiding Principles for Evaluators(revision), July 2004, from:http://www.eval.org/Publications/aea06.GPBrochure.pdf
[100]Aspinwall,K.,Simkins, T.,Wilkinson, J.F.,& McAnley, M. J.(1992) Managing Evaluation in Education. (p38) New York:Routledge
[101]Beywl, W.,& Speer, S.(2004) Data-and Literature-Based Reflections on Western European Evaluation Standards and Practices, New Directions for Evaluation,104,43-54
[102]Bottani, N.,& Tuijnman, A.(1994).The Design of indicators systems.In Tuijnman, A.C.and Postlethwaite, T.N. (eds.) Monitoring the Standards of Education. (pp47-77) Trowbridge:Redwood Books.
[103]Bresters, D.W.& Kalkwijk, J.P.(1990) The Role of the Inspectorate of Higher Education, In Goedegebuure, L.C.J. Maassen, P.A.M.& Westerheijden, D.F. (Eds.) Peer review and performance indicators:Quality assessment in British and Dutch higher education. (pp456-464) Utrecht:Lemma BV.
[104]Brinkerhoff, B.O.,Brethower, D. M.,Hluchyj, T.& Nowakowski, J. R.(1986) Program Evaluation:A Practition's Guide for Trainers and Educators.(p56). Boston:Kluwer-Nijhoff
[105]Chatterji, M.,(2005) Applying the Joint Committee's 1994 Standards in International Contexts:A Case Study of Education Evaluations in Bangladesh, Teachers College Record Volume 107, Number 10, October 2005,pp2372-2400, Teachers College, Columbia University
[106]Cook, T. D.(1974).The Potential and Limitations of Secondary Evaluation, In M. W. Apple, M. J. Subkoviak,& H. S.Lufler, Jr. (Eds.).Educational Evaluation-Analysis and Responsibility (pp155-235).Berkeley, CA:MrCutrhan.
[107]Cook, T. D.& Gruder, C.L.(1978). Metaevaluation Research. Evaluation Quarterly,2(1)
[108]Cook, T. D.& Strawr, R. B.(1990) Meta-evaluation. In H.J.Walberg & G D. Haertel (Eds.) The International Encyclopedia of Educational Evaluation (pp58-61).New York:Pergamon
[109]Cooksy, L. J.,Caracelli, V. J.(2005) Quality, Context, and Use:Issues in Achieving the Goals of Metaevaluation, American Journal of Evaluation,26(1), 31-42
[110]Dalkey, N.(1969) The Delphi method:An experimental study of group opinion. (p3) CA:Rand.
[111]Darlene Russ-Eft,& Hallie Preskill (2008) Improving the quality of evaluation participation:a meta-evaluation, Human Resource Development International, 11(1),35-50
[112]De weert, Egbert & Boezerooy, Patra (2007) Higher Education in the Netherlands. (p13). Uniersity of Twente:CHEPS, from: http://www.utwente.nl/cheps/research/higher_education_monitor/2007countryrepo rtnl.pdf
[113]Degracie, J.S.(2004) Implications of using the revised program evaluation standards in local education agencies, Journal of Experimental Education,63(1), 45-53
[114]Deirdre, C. L.,et al.(2003) Descriptive Metaevaluation:Case Study of an Interdisciplinary Curriculum, Evaluation & the Health Professions,26(4),447-461
[115]Donald B.Yarbrough, Lyn M. Shulha, Flora Caruthers (2004) Background and History of the Joint Committee's Program Evaluation Standards, New Directions for Evaluation, No.104, Wiley Periodicals, Inc.,15-30
[116]Evaluation Research Society Standards Committee (1982) Evaluation research society standards for program evaluation, New Directions for Program Evaluation, 15:7-19
[117]Finn, C.E.,Stevens, F. I.,Stufflebeam, D.L.,& Walberg, H.J.(1997) A Meta-evaluation, In H.Miller (Ed.),The New York City public schools integrated learning systems project. International Journal of Educational Research,27: 159-174
[118]Fitzpartrick,J.L.,Sanders,J.R.,& Worthen,B.R.(2004) Program evaluation: Alternative approaches and practical guidelines(3rd ed.). (pp134-135).Boston/Allyn and Bacon:Pearson Education.
[119]Hansen, J. B.(1998) Evaluating the Evaluators:The External Evaluator's Perspective, Presentation in the symposium:Evaluating the Evaluators:How Should We Evaluate the Effectiveness of Evaluation Units?American Educational Research Association-Division H,San Diego, CA
[120]Hanssen, C. E. (2008)Concurrent Meta-Evaluation:A Critique, American Journal of Evaluation,29(4),572-582
[121]Hood, C.(1991)A Public management for all seasons? Public Administration, 69(1),3-19
[122]Jan Kolkwijk,(1992) The Netherlands:The Inspectorate Perspective, Quality Assurance in Quality Assurance in Higher Education. Proceedings of an International Conference, ED371651.Hong Kong, Ed. Alma Craft, The Farmer Press
[123]Jeliazkova, M.& Westerheijden, D.F. (2004) The Netherlands:A Leader in Quality Assurance Follows the Accreditation Trend, In:Schwarz, S.and Westerheijden, D.F. (eds.)Accreditation and Evaluation in the European Higher Education Area, (pp323-345) Kluwer Academic Publishers
[124]Joint Committee on Standards for Educational Evaluation(1981)Standards for Evaluations of Educational Programs, Projects and Materials, New York: McGraw-Hill
[125]Joint Committee on Standards for Educational Evaluation(1994) The program evaluation standards (2nd ed.).Thousand Oaks, CA:Sage.
[126]Kalkwijk, J.(1992) The Netherlands:The Inspectorate Perspective. In:Alma Craft (Eds.)Quality assurance in higher education:proceedings of an international Conference, (pp97-107), The Falmer Press.
[127]Karl Dittrich and Leendert Klaassen (2007) The accreditation system in The Netherlands and Flanders In Alessandro Cavalli (eds.)Quality Assessment for Higher Education, (pp115-125)Portland Press Ltd.
[128]Keun-bok Kang & Chan-goo Yi (2000, May).A design of the metaevaluation model.Poster session presented at the annual meeting of the Canadian Evaluation Society, Montreal, Canada
[129]Linstone, H.A. and Turoff, M.,(Eds.)(1975) The Delphi Method:Techniques and applications.From:http://www.is.njit.edu/pubs/delphibook/chl.html
[130]Maassen, P. A.M.(1998)Quality Assurance in the Netherlands, New Directions for Institutional Research,99,19-28,Jossey-Bass Publishers
[131]Madaus, G.F.,Scriven M.,& Stufflebeam, D.L.(1983)Evaluation Models: Viewpoints on Educational and Human Service,(pp 138-140).Klaswer N-sjhoff Publishing
[132]Maria Bustelo, Metaevaluation as a Tool for the Improvement and Development of the Evaluation Function in Public Administrations. Presentation to the 2002 European Evaluation Society. Conference.From: www.evaluationcanada.ca/txt/newsletter200409.pdf
[133]Marlene, M. Laubliloud, (2004) Setting Standards and Providing Guidelines: The Means toward What End? Evaluation,10(2),237-245
[134]Naccarella, L.,et al. (2007) Building evaluation capacity:Definitional and practical implications from an Australian case study, Evaluation Program Planning,30(3),231-236
[135]Nelson T O.(1996) Consciousness and metacognition, American Psychologist, 51(2):102-116
[136]Nilsson,N.& Hogben, D.(1983)Metaevaluation, in E.R. House (Ed.) Philosophy of Evaluation, (pp313-327). San Francisco:Jossey-Bass
[137]Nyirenda, Stanley,(1994) Assessing Highly Accomplished Teaching: Developing a Metaevaluation Criteria Framework for Performance-Assessment Systems for National Certification of Teachers, Journal of Personnel Evaluation in Education,8(3),313-327
[138]Odom, S.L.,& Fewell, R. R.,(1983)Program Evaluation in Early Childhood Special Education:A Meta-Evaluation, Educational Evaluation and Policy Analysis,5(4),445-460
[139]Operating Procedures for the Development and Approval of Standards of the Joint Committee on Standards for Educational Evaluation,2006, from: http://www.jcsee.org/wp-content/uploads/2009/09/OperProc.pdf
[140]Patel, M. (2002) A meta-evaluation, or quality assessment, of the evaluations in this issue, based on the African Evaluation Guidelines:2002, Evaluation and Program Planning 25,329-332
[141]Quality assurance in higher education in the Netherlands and Flanders, Court of Audit of Belgium-Netherlands,4 September,2008, p9
[142]Rebolloso E.,et al.(2002) Metaevaluation of a total quality management evaluation system, Psychology in Spain,6(1),12-25
[143]Russon, C. (2000) The Program Evaluation Standards in International Settings, Kalamazoo:Western Michigan University Evaluation Center
[144]Sanders, J. R.,(1994) The Process of Developing National Standards That Meet ANSI Guidelines, Journal of Experimental Education,63(1),5-12
[145]Sanders, J.R,(1999) Metaevaluation of'the effectiveness of comprehensive, case management interventions:Evidence from the national evaluation of the comprehensive child development program',American Journal of Evaluation,20 (3),577-582
[146]Schwandt, T. A.,& Halpern, E. S.(1988).Linking Auditing and Metaevaluation, (p83).Newbury Park, CA:SAGE Publications
[147]Scriven,M. S.(1969).An introduction to meta-evaluation. Educational Products Report,2,36-38
[148]Scriven, M.(1972).An introduction to meta-evaluation. In P. A. Taylor,& D. M. Cowley (eds.).Readings in curriculum evaluation(pp84-86).Chicago: University of Chicago.
[149]Scriven, M.(1974). Evaluation perspectives and procedure, In W. J. Popham (Ed.) Evaluation in education:current applications, (pp3-33),Berkeley, CA: McCutchen.
[150]Scriven M.(1975) Evaluation Bias and Its Control, from: http://www.wmich.edu/evalctr/pubs/ops/ops04.pdf
[151]Scriven, M(1981).Evaluation Thesaurus.(pp43-45) CA:Edge Press.
[152]Smith,N. L.(1981)Criticism and Meta-Evaluation. In N. L. Smith(Ed.)New Techniques for Evaluation (pp266-273)Newbury Park, CA:SAGE Publications.
[153]Stufflebeam, D.L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service No.ED090319)
[154]Stufflebeam, D.L(1981)Metaevaluation:Concept, Standards, and Uses. In R. A. Berk (Eds.),Educational Evaluation Methodology:The State of The Art (ppl46-163).Baltimore, MD:Johns Hopkins University
[155]Stufflebeam, D.I.(1982) A Next Step:Discussion to Consider Unifying the ERS and Joint Committee Standards, In P. H.Rossi (Eds.)Standards for Evaluation Practice, pp30-31
[156]Stufflebeam,,D.L.& Shinkfield,A.J.(1985) Systematic Evaluation:A self-instruction guide to theory and practice. (pp68-76)Boston:Kluwer-Nijhoff.
[157]Stufflebeam, D.L. (2000).The methodology of metaevaluation. In D.L. Stufflebeam, G.F. Madaus & T.Kellaghan. Evaluation models:Viewpoint on educational and human services evaluation. (2nd ed.), (pp458-471).Boston: Kluwer
[158]Stufflebeam, D.L. (2001)The Metaevaluation Imperative, American Journal of Evaluation,22(2),183-209
[159]Stufflebeam, D.L. (2004) A Note on the Purposes, Development, and Applicability of the Joint Committee Evaluation Standards, American Journal of Evaluation,25(1),99-102
[160]Stufflebeam, D.L. and Shinkfield,A.J.(2007) Evaluation Theory, Models,& Applications.(p647).San Francisco:CA. Jossey-Bass.
[161]The draft of program evaluation standards, From: http://www.wmich.edu/evalctr/jc/
[162]Thompson, B.(2004) The revised program evaluation standards and their correlation with the evaluation use literature, Journal of Experimental Education, 63(1),54-82
[163]Uusikyla, Petri,& Virtanen, Petri (2000) Meta-Evaluation as a Tool for Learning: A Case Study of the European Structural Fund Evaluations in Finland, Evaluation,6(1),50-65
[164]Walberg, H.J.& Haertel, G. D. (eds.)(1990) The international encyclopedia of educational evaluation, (pp229-230). Oxford:Pergamon Press,
[165]Widmer, T,(2004) The Development and Status of Evaluation Standards in Western Europe, New Directions for Evaluation,104,31-42
[166]Worthen,B.S..(1974)A Look at the Mosaic of Educational Evaluation and Accountability, from http://www.eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/ 36/dd/e0.pdf
2 《教育部关于规范普通中小学校检查、评估工作的意见》(教督[2007]1号),引自http://www.chinaedu.edu.cn/e21sqlimg/html temple/2007-06-19/article 18512.htm
3 规范评估工作 提高评估质量——教育部召开高枝本科教学评估研讨会,《中国教育报》2008年4月12日第1版
1 转引自苏锦丽,展望我国教育评鉴专业之发展,国立台湾师范大学教育研究中心举办“教育评鉴回顾与展望”学术研讨会论文集,2004年,24-27
2Madaus, G.F.,Stufflebeam, D. L.,& Scriven, M.S.(1983) Program evaluation:A historical overview. In G.E Madaus et al. (eds.). Evaluation model:Viewpoints on educational and human services evaluation (pp.1-22).Boston:Kluwer Academic.
1 Fitzpartrick.J.L.,Sanders,J.R.,& Worthen,B.R.(2004) Program evaluation:Alternative approaches and practical guidelines(3rd ed.). (pp134-135).Boston/Allyn and Bacon:Pearson Education.
1 Stufflebeam, D. L. and Shinkfield,A.J. (2007) Evaluation Theory, Models,& Applications. (p647). San Francisco:CA. Jossey-Bass.
1 唐莹、瞿葆奎：元理论与元教育学引论,华东师范大学学报(教育科学版),1995年第1期,1-14
2 汪玲、方平、郭德俊：元认知的性质、结构与评定方法,心理学动态,1999年第1期,6-11
3 黑格尔：小逻辑,北京,商务印书馆,1980年版,第90页
4 瞿葆奎主编,陈玉琨著：教育学文集·教育评价学,北京,人民教育出版社,1999年版,第15页
1 Joint Committee on Standards for Educational Evaluation(1981) Standards for Evaluations of Educational Programs, Projects and Materials (p12) New York:McGraw-Hill
2 Walberg, H. J.& Haertel, G D. (eds.)(1990) The international encyclopedia of educational evaluation, (pp229-230).Oxford:Pergamon Press,
3 Stufflebeam,,D.L.& Shinkfield,A.J.(1985) Systematic Evaluation:A self-instruction guide to theory and practice. (pp68-76)Boston:Kluwer-Nijhoff.
4 Scriven, M.(1972).An introduction to meta-evaluation. In P. A. Taylor,& D. M.Cowley,(eds.).Readings in curriculum evaluation(pp84-86).Chicago:University of Chicago.
5 Stufflebeam, D. L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service No. ED090319)
1 Stufflebeam, D. L (1981)Metaevaluation:Concept, Standards, and Uses. In R. A. Berk (Eds.), Educational Evaluation Methodology:The State of The Art (pp146-163). Baltimore, MD:Johns Hopkins University
2 Orata, P. T.(1940) Evaluating Evaluation, Journal of Educational Research, volumn ⅩⅩⅩⅢ(9),641-646
3 Scriven,M. S.(1969).An introduction to meta-evaluation. Educational Products Report,2,36-38
1 Madaus,G.F.,Stufflebeam,D. L..& Scriven,M.S.(1983).Program Evaluation:A Historical Overview. In Madaus, G.F., Scriven, M.&.Stufflebeam, D. L. (Eds.). Evaluation Models.(pp3-22).Hingham: Kluwe-Nijhoff.
2 游家政：国民小学后设评鉴标准之研究,国立台湾师范大学教育研究所博士论文,1994年
1 Scriven,M. S.(1969).An introduction to meta-evaluation. Educational Products Report,2,36-38
2 Cook, T. D.(1974). The Potential and Limitations of Secondary Evaluation, In M. W. Apple, M.J.Subkoviak,& H.S.Lufler, Jr.(Eds.).Educational Evaluation:Analysis and Responsibility (pp.155-235). Berkeley, CA:
MrCutrhan.
3 Stufflebeam, D. L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service, No. ED090319).
4 Stufflebeam, D. L.(1981)Metaevaluation:Concept, Standards, and Uses. In R. A. Berk (Eds.), Educational
Evaluation Methodology:The State of The Art (pp 146-163). Baltimore, MD:Johns Hopkins University
5 Cook, T. D.,& Gruder, C. L.(1978).Metaevaluation Research. Evaluation Quarterly,2(1)
6 Nilsson,N.& Hogben, D.(1983) Metaevaluation, in E. R. House (Ed.) Philosophy of Evaluation, (pp313-327). San Francisco:Jossey-Bass
7 Brinkerhoff, B. O.,Brethower, D. M.,Hluchyj,T.& Nowakowski, J. R.(1986) Program Evaluation:A
Practition's Guide for Trainers and Educators. (p56). Boston:Kluwer-Nijhoff
5 Schwandt, T. A.,& Halpern, E. S.(1988). Linking Auditing and Metaevaluation, (p83). Newbury Park, CA: SAGE Publications
9 Aspinwall, K.,Simkins, T, Wilkinson, J. F.,& McAnley, M. J.(1992) Managing Evaluation in Education. (p38) New York:Routledge
1 The Joint Committee on Standards for Educational Evaluation(1981)Standards for Evaluation of Educational Programs, Projects, and Materials.(p18) New York:McGraw-Hill.
2 Evaluation Research Society Standards Committee(1982) Evaluation research society standards for program evaluation, New Directions for Program Evaluation,15:7-19
1 Nyirenda, Stanley,(1994) Assessing Highly Accomplished Teaching:Developing a Metaevaluation Criteria Framework for Performance-Assessment Systems for National Certification of Teachers, Journal of Personnel Evaluation in Education,8(3),313-327
2 Finn, C. E., Stevens, F. I., Stufflebeam, D. L.,& Walberg, H. J.(1997) A Meta-evaluation, In H. Miller (Ed.), The New York City public schools integrated learning systems project. International Journal of Educational Research,27,159-174
3 Sanders, J. R,(1999) Metaevaluation of'the effectiveness of comprehensive, case management interventions: Evidence from the national evaluation of the comprehensive child development program',American Journal of Evaluation,20(3),577-582
4 Marlene, M.Laubliloud, (2004) Setting Standards and Providing Guidelines:The Means toward What End? Evaluation,10(2),237-245
5 转引自苏锦丽,黄曙东：世界重要国家评鉴专业标准与原则发展对我国之启示,高教评鉴,2007年第1期,51-82
6 Naccarella, L., et al. (2007) Building evaluation capacity:Definitional and practical implications from an Australian case study, Evaluation Program Planning,30(3),231-236
1 Patel, M. (2002) A meta-evaluation, or quality assessment, of the evaluations in this issue, based on the African Evaluation Guidelines:2002, Evaluation and Program Planning 25,329-332
2 Jan Kolkwijk,(1992) The Netherlands:The Inspectorate Perspective, Quality Assurance in Quality Assurance in Higher Education. Proceedings of an International Conference, ED371651.Hong Kong, Ed. Alma Craft, The Farmer Press
3 严芳：荷兰高等教育外部质量保障新机制探析,高教发展与评估,2006年第1期,55-59
4 Stufflebeam, D. L. (2000) The methodology of metaevaluation. In D. L. Stufflebeam, G F. Madaus & T.Kellaghan, Evaluation models:Viewpoint on educational and human services evaluation. (2nd ed.), (pp458-471).Boston:Kluwer
5 Hanssen, C. E. (2008) Concurrent Meta-Evaluation:A Critique, American Journal of Evaluation,29(4),572-582
6 Russon, C. (2000) The Program Evaluation Standards in International Settings, Kalamazoo:Western Michigan University Evaluation Center
7 徐枞巍,许建钺：元评估及教育评估信度与效度的扩展模型,中国高等教育评估,1997年第2期,2-4
8 方鸿琴：国外教育元评估的分析及对我国的启示,江苏高教,2004年第1期,92-95
1 史耀芳：略论教育评价中的元评价,教育理论与实践,1991年第5期,42-44
2 侯光文：试论教育评价元评价,教育理论与实践,1998年第4期,23-26
3 许茂祖：论高等教育评估中的再评估,中国高等教育评估,2000年第4期,27-31
4 顾永才：教育评价活动的再评价,教育研究,1990年第4期,71-73
5 陈玉琨：中国高等教育评论,广东：广东高等教育出版社,1993年版,46-61
6 周志刚：对再评估的探讨：值得重视和研究的问题,1996年国际教育评估与质量保证会议交流材料
7 陈玉琨、李如海：我国教育评价的发展的世纪回顾与未来展望,华东师范大学学报(教育科学版),2000年第1期,1-12
8 高洁、蔡敏：美国教育评价的元评价及其启示,世界教育信息,2007年第6期,21-24
9 王云峰、曲霏：基于元评估理论的学科评估应用研究,科研管理,2009年第1期,143-148
10 吴建南、白波：评估政府绩效评估：元评估方法的探索性应用,行政论坛,2009年第6期,32-37
11 王雁、章仁彪：教育元评估的理念与标准辫析,中国高等教育评估,2009年第1期,41-44
12 张守臣：论本科教学工作水平评估的元评估问题,中国高教研究,2009年第3期,29-30
13 熊光慈：高等教育元评估——高等教育评估的偏差研究,河南,郑州大学出版社,2009年版
1 孙锐、王战军、周学军：浅议高等教育评估机构的社会职能及其实现,中国高教研究,2001年第11期：38-39
2 顾明远：高等教育评估中几个值得探讨的问题,高教发展与评估,2006年第3期,1-3
3 冯晖：教育评价中的敏感性问题研究,华东师范大学学报(教育科学版),2007年第2期,37-41
4 杨晓江：试论我国高等教育评估制度的建立,云南教育,2002年第24期：69-73
5 国防科技大学研究生院编著：教育评估理论与方法及在研究生教育评估中的应用,北京,国防科技大学出版社,2004年版
6 徐明欣、高斌、李瑞年、鞠传进：元评估在学校体育评估实践中应用的研究,青岛大学学报,2000年第4期,74-80
7 贺祖斌：高等教育评价的元评价及其量化分析模型,广西民族学院学报(哲学社会科学版),2001年第4期,123-126
8 钱存阳、李丹青、潘岚：课堂教学质量评价元评价中的效度和信度分析,中国计量学院学报,2004年第2期,164-167
威廉·维尔斯曼著,袁振国主译：教育研究方法导论,北京,教育科学出版社,1997年版,第17-21页
1 亚里士多德著,关寿彭译：形而上学,北京,商务印书馆,1959年版,第79页
1 (美)加来道雄著,晓颖译：不可思议的物理,上海,上海科学技术文献出版社,2009年版,第5页
2 (美)A·P·马蒂尼奇编：《语言哲学》,北京,商务印书馆,1998年版,第91页
3 (英)罗伊·索伦森著,贾红雨译：悖论简史：哲学和心灵的迷宫,北京,北京大学出版社,2007年版,第10页
1 Nelson T O.,(1996) Consciousness and metacognition, American Psychologist,51(2):102-116
2 刘森林：元语用论概述,解放军外国语学院学报,2001年第4期,6-10
1 唐莹著：元教育学,北京,人民教育出版社,2002年版,第34页
2 张青松：源态理论、原态理论与元态理论——广义元理论研究之一,理论探讨,2005年第3期,92-94
1 李振伦：元理论与元哲学,河北学刊,1996年第6期,27-31
2 唐莹,瞿葆奎：元理论与元教育学引论,华东师范大学学报(教育科学版)1995年第1期,1-14
1 唐莹：元教育学——西方教育学认识论剪影(上),教育研究,2001年第2期,11-21
2 焦建利：教育技术学元研究论纲,电化教育研究,2004年第4期,8-13
3 Scriven, M.(1972) An introduction to meta-evaluation. In P. A. Taylor,& D. M.Cowley, (eds.). Readings in curriculum evaluation(pp.84-86).Chicago:University of Chicago.
1 Stufflebeam, D. L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service No. ED090319)
2 许国志、顾基发、车宏安编：系统科学,上海,上海科技教育出版社,2000年版,第1页
3 冯·贝塔朗菲著,林康义、魏宏森译：一般系统论：基础、发展和应用,北京,清华大学出版社,1987年版,第64-70页
1 (美)美国国家研究理事会,戢守志等译：美国国家科学教育标准,上海,科学技术文献出版社,1999年版,第140-141页
1 N·维纳著,郝季仁译：控制论,北京,北京大学出版社,2007年版,第3-8页
1 邵光远,张纪川编著：系统科学入门,北京,知识出版社,1990年版,第61-65页
2 李金松编著：系统论、信息论、控制论与教育改革,湖北,湖北教育出版社,1989年版,第133-136页
1 查有梁著：系统科学与教育,北京,人民教育出版社,1993年版,第10页
1 Scriven, M.S.(1969). An introduction to meta-evaluation. Educational Products Report,2,36-38
2 Scriven, M(1981).Evaluation Thesaurus. (pp43-45).CA:Edge Press.
3 Cook,T.D.(1974). The Potential and Limitations of Secondary Evaluation, In M.W. Apple, M.J.Subkoviak,& H.S.Lufler, Jr.(Eds.).Educational Evaluation:Analysis and Responsibility (pp155-235). Berkeley, CA: MrCutrhan.
1 Cook, T.D.,& Gruder, C. L.(1978). Metaevaluation Research. Evaluation Quarterly,2(1),5-51
2 Stufflebeam, D. L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service No. ED090319)
1 Stufflebeam, D. L.(1981)Metaevaluation:Concept, Standards, and Uses. In R. A. Berk (Eds.), Educational Evaluation Methodology:The State of The Art (pp146-163). Baltimore, MD:Johns Hopkins University
2 Nilsson,N.& Hogben, D.(1983) Metaevaluation, in E. R. House (Ed.)Philosophy of Evaluation, (pp313-327). San Francisco:Jossey-Bass
3 Schwandt, T. A.,& Halpern, E. S.(1988). Linking Auditing and Metaevaluation, (p83). Newbury Park, CA: SAGE Publications
4 Aspinwall, K.,Simkins,T,Wilkinson, J. F.,& McAnley, M.J.(1992) Managing Evaluation in Education. (p38). New York:Routledge
5 Stufflebeam, D. L. (2001)The Metaevaluation Imperative, American Journal of Evaluation,22(2),183-209
6 陈玉琨：教育评价学,北京,人民教育出版社,1999年版,第8页
1 Scriven, M.(1974). Evaluation perspectives and procedure, In W. J. Popham (Ed.)Evaluation in education: current applications, (pp3-33), Berkeley, CA:McCutchen.
2 Cook, T.D.(1974) The Potential and Limitations of Secondary Evaluation. In M. W. Apple, M..J. Subkoviak,& H.S.Lufler, Jr. (Eds.).Educational Evaluation:Analysis and Responsibility (pp155-235). Berkeley, CA: MrCutrhan
3 Smith, N. L.(1981)Criticism and Meta-Evaluation. In N. L. Smith (Ed.) New Techniques for Evaluation (pp266-273) Newbury Park, CA:SAGE Publications.
4 Cook, T. D.,& Strawr, R. B.(1990) Meta-evaluation. In H. J. Walberg & G.D. Haertel (Eds.)The International Encyclopedia of Educational Evaluation (pp58-61).New York:Pergamon
5 Stufflebeam and Shinkfield (2007). Evaluation Theory, Models,& Applications. (p650).San Francisco:CA. Jossey-Bass
1 Brinkerhoff, B.O.,Brethower, D. M.,Hluchyj,T.& Nowakowski, J. R.(1986) Program Evaluation:A Practition's Guide for Trainers and Educators. (p56). Boston:Kluwer-Nijhoff
1 Cook, T.D.& Gruder, C.(1978) Metaevaluation research, Evaluation quality,2(1),5-51
1转引自Madaus, G F.,Scriven M.,& Stufflebeam, D. L.(1983) Evaluation Models:Viewpoints on Educational and Human Service. (pp138-140). Klaswer N-sjhoff Publishing
1 The draft of program evaluation standards, From:http://www.wmich.edu/evalctr/jc/
1 Evaluation Research Society(1982) Standards for program evaluation, New Directions for Program Evaluation, 15,7-19
1 Worthen,B. S..(1974)A Look at the Mosaic of Educational Evaluation and Accountability,from http://www.eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/36/dd/e0.pdf
1 Schwandt, T. A.,& Halpern, E. S.(1988). Linking Auditing and Metaevaluation, (p34). Newbury Park, CA: SAGE Publications
2 转引自Keun-bok Kang & Chan-goo Yi (2000, May). A design of the metaevaluation model. Poster session presented at the annual meeting of the Canadian Evaluation Society, Montreal, Canada
3 Keun-bok Kang & Chan-goo Yi (2000, May).A design of the metaevaluation model. Poster session presented at the annual meeting of the Canadian Evaluation Society, Montreal, Canada
1 Stufflebeam, D. L. (2004) A Note on the Purposes, Development, and Applicability of the Joint Committee Evaluation Standards,American Journal of Evaluation,25(1),99-102
1 Stufflebeam and Shinkfield (2007). Evaluation Theory,Models,& Applications. (p653). San Francisco:CA. Jossey-Bass
2 Madaus, G.F.,Stufflebeam, D. L.,& Scriven, M. S.(1983) Program evaluation:A historical overview. In G F. Madaus et al. (eds.).Evaluation model:Viewpoints on educational and human services evaluation (pp.1-22).Boston:Kluwer Academic.
1 Fitzpartrick,J.L.,Sanders,J.R.,& Worthen,B.R.(2004) Program evaluation:Alternative approaches and practical guidelines(3rd ed.). (pp134-135).Boston/Allyn and Bacon:Pearson Education.
2 转引自苏锦丽,展望我国教育评鉴专业之发展,国立台湾师范大学教育研究中心举办“教育评鉴回顾与展望”学术研讨会论文集,2004年,24-277
3 谭福有,标准和标准化的概念,信息技术与标准化,2005年第3期,56-57
1 梁燕君,发达国家标准体系的特色与启示,大众标准化,2005年第5期,24-26
1 Joint Committee on Standards for Educational Evaluation.(1994). The program evaluation standards (2nd ed.). (p1)Thousand Oaks, CA:Sage.
2 Joint Committee on Standards for Educational Evaluation(1981)Standards for Evaluations of Educational Programs, Projects and Materials,(p1)New York:McGraw-Hill
1 Donald B.Yarbrough, Lyn M.Shulha, Flora Caruthers (2004) Background and History of the Joint Committee's Program Evaluation Standards, New Directions for Evaluation, No.104, Wiley Periodicals, Inc., pp15-30
2 Sanders, J. R.,(1994) The Process of Developing National Standards That Meet ANSI Guidelines, Journal of Experimental Education,63(1),5-12
1 Thompson, B. (2004) The revised program evaluation standards and their correlation with the evaluation use literature, Journal of Experimental Education,63(1),54-82
1 Operating Procedures for the Development and Approval of Standards of the Joint Committee on Standards for Educational Evaluation,2006, from:http://www.icsee.org/wp-content/uploads/2009/09/OperProc.pdf
1 Chatterji, M.,(2005) Applying the Joint Committee's 1994 Standards in International Contexts:A Case Study of Education Evaluations in Bangladesh, Teachers College Record Volume 107, Number 10, October 2005, pp2372-2400, Teachers College, Columbia University
2 Uusikyla, Petri,& Virtanen, Petri (2000) Meta-Evaluation as a Tool for Learning:A Case Study of the European Structural Fund Evaluations in Finland, Evaluation,6(1),50-65
3 American Evaluation Association, Guiding Principles for Evaluators(revision), July 2004, from: http://www.eval.org/Publications/aea06.GPBrochure.pdf
1 张艳敏,梁东荣：荷兰高等教育质量保证制度的发展现状探析及其启示,高等教育研究,2006年第3期,1-5
2国家行政学院编译：《西方国家行政改革述评》,北京,国家行政学院出版社,1998年版第31页
1 Hood, C.(1991) A Public management for all seasons? Public Administration,69(1),3-19
1 (荷兰)弗兰斯·F·范富格特主编,王承绪等译,国际高等教育政策比较研究,浙江,浙江教育出版社,2001年版第253页
2 De weert, Egbert & Boezerooy, Patra (2007) Higher Education in the Netherlands. (pp13). Uniersity of Twente: CHEPS, from:http://www.utwente.nl/cheps/research/higher_education_monitor/2007countryreportnl.pdf
1 Karl Dittrich and Leendert Klaassen (2007) The accreditation system in The Netherlands and Flanders In Alessandro Cavalli (eds.) Quality Assessment for Higher Education, (pp115-125)Portland Press Ltd.
2 Quality assurance in higher education in the Netherlands and Flanders, Court of Audit of Belgium-Netherlands, 4 September,2008, p9
1 Kalkwijk, J.(1992) The Netherlands:The Inspectorate Perspective. In:Alma Craft(Eds.) Quality assurance in higher education:proceedings of an international Conference, (pp97-107), The Falmer Press.
1 Bresters, D. W.& Kalkwijk, J. P., The Role of the Inspectorate of Higher Education, In Goedegebuure, L.C.J. Maassen, P.A.M.& Westerheijden, D.F. (Eds.) Peer review and performance indicators:Quality assessment in British and Dutch higher education. (pp456-464)Utrecht:Lemma BV.
2 Jeliazkova, M.& Westerheijden, D.F. (2004) The Netherlands:A Leader in Quality Assurance Follows the Accreditation Trend, In:Schwarz, S. and Westerheijden, D.F. (eds.) Accreditation and Evaluation in the European Higher Education Area, (pp323-345) Kluwer Academic Publishers
1 Maassen, P. A. M.(1998) Quality Assurance in the Netherlands, New Directions for Institutional Research,99, 19-28, Jossey-Bass Publishers
2 Karl Dittrich and Leendert Klaassen (2007) The accreditation system in The Netherlands and Flanders In Alessandro Cavalli (eds.) Quality Assessment for Higher Education, (pp115-125)Portland Press Ltd.
1陶西平：教育评价辞典,北京,北京师范大学出版社,1998年版,第112页
2 Bottani, N.,& Tuijnman, A.(1994).The Design of indicators systems. In Tuijnman, A.C. and Postlethwaite, T.N. (eas.) Monitonng the Standards of Education. (pp47-77) Trowbridge:Redwood Books.
1 Joint Committee on Standards for Educational Evaluation.(1994). The program evaluation standards (2nd ed.). (p3) Thousand Oaks, CA:Sage.
1 王致和主编：高等学校教育评估,北京,北京师范大学出版社,1995年版第62页
1 刘淑兰：教育评估和督导,上海,华东师范大学出版社,2000年版,第73页
2 Linstone, H. A. and Turoff, M.,(Eds.)(1975) The Delphi Method:Techniques and applications. (p68) From: http://www.is.njit.edu/pubs/delphibook/chl.html
1 Dalkey, N.(1969) The Delphi method:An experimental study of group opinion.(p3)CA:Rand.
1 Stufflebeam, D.I.(1982) A Next Step:Discussion to Consider Unifying the ERS and Joint Committee Standards, In P. H. Rossi(Eds.)Standards for Evaluation Practice, pp30-31
1 中国的职业培训体系,中华人民共和国人力资源和社会保障部网站,from；http://wl.mohrss.gov.cn/gb/ywzn/2005-12/05/content_96561.htm
2 上海市劳动和社会保障局关于修改《本市民办职业培训机构审批和管理暂行办法》的通知(沪劳保技发[2006]23号)
1 仇立平：社会研究方法,重庆,重庆大学出版社,2008年版,第240-244页
1 陶西平：教育评价辞典,北京,北京师范大学出版社,1998年版第85页
1 吴启迪,中国高等教育评估体系的构建与完善,教育发展研究,2009年第3期,38-41
1 (美)曼昆著,梁小民译：经济学原理(第三版)(下册),北京：机械工业出版社,2003年版,第78页
[1]别敦荣：论高等教育评估的功能,高等教育研究,2002年第6期,34-38
[2]别敦荣：论高等教育评估的基本特征,辽宁教育研究,2004年第4期,14-16
[3]邵光远、张纪川编著：系统科学入门,北京,知识出版社,1990年版
[4]陈玉琨：中国高等教育评论,广东：广东高等教育出版社,1993年版
[5]陈玉琨、李如海：我国教育评价的发展的世纪回顾与未来展望,华东师范大学学报(教育科学版),2000年第1期,1-12
[6]方鸿琴：国外教育元评估的分析及对我国的启示,江苏高教,2004年第1期,92-95
[7]冯·贝塔朗菲著,林康义、魏宏森译：一般系统论：基础、发展和应用,北京,清华大学出版社,1987年版
[8]冯晖：教育评价中的敏感性问题研究,华东师范大学学报(教育科学版),2007年第2期,37-41
[9]弗兰斯·F·范富格特主编,王承绪等译,国际高等教育政策比较研究,浙江,浙江教育出版社,2001年版
[10]高洁、蔡敏：美国教育评价的元评价及其启示,世界教育信息,2007年第6期,21-24
[11]顾明远：高等教育评估中几个值得探讨的问题,高教发展与评估,2006年第3期,1-3
[12]顾永才：教育评价活动的再评价,教育研究,1990年第4期,71-73
[13]规范评估工作提高评估质量——教育部召开高校本科教学评估研讨会,《中国教育报》2008年4月12日第1版
[14]国防科技大学研究生院编著：教育评估理论与方法及在研究生教育评估中的应用,北京,国防科技大学出版社,2004年版
[15]国家行政学院编译：《西方国家行政改革述评》,北京,国家行政学院出版社,1998年版
[16]教育部,《教育部关于规范普通中小学校检查、评估工作的意见》(教督[2007]1号),引自http://www.chinaedu.edu.cn/e21sqlimg/html_temple/2007-06-19/article_18512.ht m
[17]贺祖斌：高等教育评价的元评价及其量化分析模型,广西民族学院学报(哲学社会科学版),2001年第4期,123-126
[18]黑格尔：小逻辑,北京,商务印书馆,1980年版
[19]侯光文：试论教育评价元评价,教育理论与实践,1998年第4期,23-26
[20]黄光扬：教育测量与评价,上海,华东师范大学出版社,2002年版
[21]加来道雄著,晓颖译：不可思议的物理,上海,上海科学技术文献出版社,2009年版
[22]焦建利：教育技术学元研究论纲,电化教育研究,2004年第4期,8-13
[23]金娣、王刚：教育评价与测量,北京：教育科学出版社,2002年版
[24]李金松编著：系统论、信息论、控制论与教育改革,湖北,湖北教育出版社,1989年版
[25]李振伦：元理论与元哲学,河北学刊,1996年第6期,27-31
[26]梁燕君：发达国家标准体系的特色与启示,大众标准化,2005年第5期,24-26
[27]林正范,贾群生：多元高等教育评价主体价值取向比较研究,清华大学教育研究,1999年第3期：36-40
[28]林正范,贾群生：高等教育质量概念探析,高等教育研究,1999年第4期：61-64
[29]刘军山、孟万金：关于高等教育评价指标体系质量的探讨,江苏高教,1999年第6期：11-13
[30]刘军山、徐枞巍：高等教育评价指标体系质量问题的理论探讨,北京航空航天大学学报(社会科学版),2000年第1期：57-59
[31]刘森林：元语用论概述,解放军外国语学院学报,2001年第4期,6-10
[32]刘淑兰：教育评估和督导,上海,华东师范大学出版社,2000年版
[33]刘志军：教育评价的反思与建构,教育研究,2004年第2期：59-64
[34]罗伊·索伦森著,贾红雨译：悖论简史：哲学和心灵的迷宫,北京,北京大学出版社,2007年版
[35]马蒂尼奇编,牟博等译,：《语言哲学》,北京,商务印书馆,1998年版
[36]曼昆著,梁小民译：经济学原理(第三版)(下册),北京：机械工业出版社,2005年版
[37]美国国家研究理事会,戢守志等译：美国国家科学教育标准,上海,科学技术文献出版社,1999年版
[38]钱存阳、李丹青、潘岚：课堂教学质量评价元评价中的效度和信度分析,中国计量学院学报,2004年第2期,164-167
[39]仇立平：社会研究方法,重庆,重庆大学出版社,2008年版
[40]瞿葆奎主编,陈玉琨著：教育学文集·教育评价学,北京,人民教育出版社,1999年版
[41]史耀芳：略论教育评价中的元评价,教育理论与实践,1991年第5期,42-44
[42]史耀芳：教育评价新策略——谈谈国外有关教育评价中的元评价研究,外国教育资料,1994年第3期：64-68
[43]苏锦丽：大学学科评鉴试办计划成效评估之研究,台北,师大书苑,1995年版
[44]苏锦丽：展望我国教育评鉴专业之发展,国立台湾师范大学教育研究中心举办“教育评鉴回顾与展望”学术研讨会论文集,2004年,24-27
[45]苏锦丽,黄曙东：世界重要国家评鉴专业标准与原则发展对我国之启示,高教评鉴,2007年第1期,51-82
[46]孙锐、王战军、周学军：浅议高等教育评估机构的社会职能及其实现,中国高教研究,2001年第11期：38-39
[47]谭福有,标准和标准化的概念,信息技术与标准化,2005年第3期,56-57
[48]唐莹：元教育学,北京,人民教育出版社,2002年版
[49]唐莹：元教育学——西方教育学认识论剪影(上),教育研究,2001年第2期,11-21
[50]唐莹、瞿葆奎：元理论与元教育学引论,华东师范大学学报(教育科学版),1995年第1期,1-14
[51]陶西平：教育评价辞典,北京,北京师范大学出版社,1998年版
[52]汪玲、方平、郭德俊：元认知的性质、结构与评定方法,心理学动态,1999年第1期,6-11
[53]王孝玲：教育测量(修订版),上海,华东师范大学出版社,2005年版
[54]王雁、章仁彪：教育元评估的理念与标准辫析,中国高等教育评估,2009年第1期,41-44
[55]王云峰、曲霏：基于元评估理论的学科评估应用研究,科研管理,2009年第1期,143-148
[56]王致和主编：高等学校教育评估,北京,北京师范大学出版社,1995年版
[57]王致和,季靖：我国高等教育评估制度建设回顾与展望,天津大学学报(社会科学版),1999年第3期：82-85
[58]王战军,孙锐：我国高等教育评估制度演进趋势探析,高等教育研究,2000年第6期：78-81
[59]威廉·维尔斯曼著,袁振国主译：教育研究方法导论,北京,教育科学出版社,1997年版
[60]维纳著,郝季仁译：控制论,北京,北京大学出版社,2007年版
[61]吴建南、白波：评估政府绩效评估：元评估方法的探索性应用,行政论坛,2009年第6期,32-37
[62]吴启迪,中国高等教育评估体系的构建与完善,教育发展研究,2009年第3期,38-41
[63]熊光慈：高等教育元评估——高等教育评估的偏差研究,河南,郑州大学出版社,2009年版
[64]夏天阳：各国高等教育评估,上海,上海科学技术文献出版社,1997年版
[65]徐景武：高等教育评估中的政府行为模式探析,江苏高教,2002年第3期,59-61／88
[66]徐明欣、高斌、李瑞年、鞠传进：元评估在学校体育评估实践中应用的研究,青岛大学学报,2000年第4期,74-80
[67]徐枞巍,许建钺：元评估及教育评估信度与效度的扩展模型,中国高等教育评估,1997年第2期,2-4
[68]许茂祖：论高等教育评估中的再评估,中国高等教育评估,2000年第4期, 27-31
[69]许国志、顾基发、车宏安编：系统科学,上海,上海科技教育出版社,2000年版
[70]荀振芳：高等教育评价的教育性视角,高等教育研究,2004年第2期：29-32
[71]亚里士多德著,关寿彭译：形而上学,北京,商务印书馆,1959年版
[72]严芳：荷兰高等教育外部质量保障新机制探析,高教发展与评估,2006年第1期,55-59
[73]杨晓江：教育评估的科学性与科学的教育评估,教育研究,2000年第8期：33-36＼75
[74]杨晓江：试论我国高等教育评估制度的建立,云南教育,2002年第24期：69-73
[75]叶国珍,杨晓江：如何看待我国高等教育评估质量,高教发展与评估,2005年第1期：47-50
[76]约翰·布伦南,特拉·沙赫著,陆爱华等译,高等教育质量管理：一个关于高等院校评估和改革的国际性观点,上海,华东师范大学出版社,2005年版
[77]查有梁著：系统科学与教育,北京,人民教育出版社,1993年版
[78]张民选：关于高等教育认证机制的研究,教育研究,2005年第2期,37-44
[79]张青松：源态理论、原态理论与元态理论——广义元理论研究之一,理论探讨,2005年第3期,92-94
[80]张守臣：论本科教学工作水平评估的元评估问题,中国高教研究,2009年第3期,29-30
[81]张艳敏,梁东荣：荷兰高等教育质量保证制度的发展现状探析及其启示,高等教育研究,2006年第3期,1-5
[82]张远增：高等教育评价方法研究,上海,复旦大学出版社,2002年版
[83]赵康,专业、专业属性及判断成熟专业的六条标准——一个社会学角度的分析,社会学研究,2000年第5期,30-39
[84]周庚渊：对评估的评估——美国对高教鉴定团体的认证,技术经济与管理研究,2005年第2期,54
[85]周志刚：对再评估的探讨：值得重视和研究的问题,1996年国际教育评估与质量保证会议交流材料
[86]鲍艳利：我国高等教育评估后评估内容与方法研究,河海大学硕士论文,2006年
[87]冯晖：元评价方法及其在高等教育评估中的应用研究,上海交通大学博士论文,2007年
[88]赖志峰：台北市幼稚园后设评鉴之研究,国立政治大学教育研究所硕士论文,1997年
[89]林劭仁：我国高级中学元评估指标之研究,国立政治大学教育研究所博士论 文,2001年
[90]刘凯：评价的合理性研究,华中科技大学硕士论文,2003年
[91]穆慧仪：国民中学后设评鉴之研究,国立台北师范学院硕士论文,2003年
[92]彭平根：评价中心的测评有效性及其影响因素的实证研究,华东师范大学博士论文,2003年
[93]曲霏：高等教育项目元评估的理论和实践研究,河北工业大学硕士论文,2007年
[94]王向红：我国高等教育评估质量保证研究,华中科技大学博士论文,2007年
[95]杨滨辉：我国高校内部教学评估体系的元评估研究,黑龙江大学硕士论文,2009年
[96]游家政：国民小学后设评鉴标准之研究,国立台湾师范大学教育研究所博士论文,1994年
[97]曾淑惠：我国专科学校后设评鉴之研究,国立台湾师范大学教育研究所博士论文,1996年
[98]张释心,桃园县私立幼稚园后设评鉴之研究,中原大学教育研究所硕士论文,2006年
[99]American Evaluation Association, Guiding Principles for Evaluators(revision), July 2004, from:http://www.eval.org/Publications/aea06.GPBrochure.pdf
[100]Aspinwall,K.,Simkins, T.,Wilkinson, J.F.,& McAnley, M. J.(1992) Managing Evaluation in Education. (p38) New York:Routledge
[101]Beywl, W.,& Speer, S.(2004) Data-and Literature-Based Reflections on Western European Evaluation Standards and Practices, New Directions for Evaluation,104,43-54
[102]Bottani, N.,& Tuijnman, A.(1994).The Design of indicators systems.In Tuijnman, A.C.and Postlethwaite, T.N. (eds.) Monitoring the Standards of Education. (pp47-77) Trowbridge:Redwood Books.
[103]Bresters, D.W.& Kalkwijk, J.P.(1990) The Role of the Inspectorate of Higher Education, In Goedegebuure, L.C.J. Maassen, P.A.M.& Westerheijden, D.F. (Eds.) Peer review and performance indicators:Quality assessment in British and Dutch higher education. (pp456-464) Utrecht:Lemma BV.
[104]Brinkerhoff, B.O.,Brethower, D. M.,Hluchyj, T.& Nowakowski, J. R.(1986) Program Evaluation:A Practition's Guide for Trainers and Educators.(p56). Boston:Kluwer-Nijhoff
[105]Chatterji, M.,(2005) Applying the Joint Committee's 1994 Standards in International Contexts:A Case Study of Education Evaluations in Bangladesh, Teachers College Record Volume 107, Number 10, October 2005,pp2372-2400, Teachers College, Columbia University
[106]Cook, T. D.(1974).The Potential and Limitations of Secondary Evaluation, In M. W. Apple, M. J. Subkoviak,& H. S.Lufler, Jr. (Eds.).Educational Evaluation-Analysis and Responsibility (pp155-235).Berkeley, CA:MrCutrhan.
[107]Cook, T. D.& Gruder, C.L.(1978). Metaevaluation Research. Evaluation Quarterly,2(1)
[108]Cook, T. D.& Strawr, R. B.(1990) Meta-evaluation. In H.J.Walberg & G D. Haertel (Eds.) The International Encyclopedia of Educational Evaluation (pp58-61).New York:Pergamon
[109]Cooksy, L. J.,Caracelli, V. J.(2005) Quality, Context, and Use:Issues in Achieving the Goals of Metaevaluation, American Journal of Evaluation,26(1), 31-42
[110]Dalkey, N.(1969) The Delphi method:An experimental study of group opinion. (p3) CA:Rand.
[111]Darlene Russ-Eft,& Hallie Preskill (2008) Improving the quality of evaluation participation:a meta-evaluation, Human Resource Development International, 11(1),35-50
[112]De weert, Egbert & Boezerooy, Patra (2007) Higher Education in the Netherlands. (p13). Uniersity of Twente:CHEPS, from: http://www.utwente.nl/cheps/research/higher_education_monitor/2007countryrepo rtnl.pdf
[113]Degracie, J.S.(2004) Implications of using the revised program evaluation standards in local education agencies, Journal of Experimental Education,63(1), 45-53
[114]Deirdre, C. L.,et al.(2003) Descriptive Metaevaluation:Case Study of an Interdisciplinary Curriculum, Evaluation & the Health Professions,26(4),447-461
[115]Donald B.Yarbrough, Lyn M. Shulha, Flora Caruthers (2004) Background and History of the Joint Committee's Program Evaluation Standards, New Directions for Evaluation, No.104, Wiley Periodicals, Inc.,15-30
[116]Evaluation Research Society Standards Committee (1982) Evaluation research society standards for program evaluation, New Directions for Program Evaluation, 15:7-19
[117]Finn, C.E.,Stevens, F. I.,Stufflebeam, D.L.,& Walberg, H.J.(1997) A Meta-evaluation, In H.Miller (Ed.),The New York City public schools integrated learning systems project. International Journal of Educational Research,27: 159-174
[118]Fitzpartrick,J.L.,Sanders,J.R.,& Worthen,B.R.(2004) Program evaluation: Alternative approaches and practical guidelines(3rd ed.). (pp134-135).Boston/Allyn and Bacon:Pearson Education.
[119]Hansen, J. B.(1998) Evaluating the Evaluators:The External Evaluator's Perspective, Presentation in the symposium:Evaluating the Evaluators:How Should We Evaluate the Effectiveness of Evaluation Units?American Educational Research Association-Division H,San Diego, CA
[120]Hanssen, C. E. (2008)Concurrent Meta-Evaluation:A Critique, American Journal of Evaluation,29(4),572-582
[121]Hood, C.(1991)A Public management for all seasons? Public Administration, 69(1),3-19
[122]Jan Kolkwijk,(1992) The Netherlands:The Inspectorate Perspective, Quality Assurance in Quality Assurance in Higher Education. Proceedings of an International Conference, ED371651.Hong Kong, Ed. Alma Craft, The Farmer Press
[123]Jeliazkova, M.& Westerheijden, D.F. (2004) The Netherlands:A Leader in Quality Assurance Follows the Accreditation Trend, In:Schwarz, S.and Westerheijden, D.F. (eds.)Accreditation and Evaluation in the European Higher Education Area, (pp323-345) Kluwer Academic Publishers
[124]Joint Committee on Standards for Educational Evaluation(1981)Standards for Evaluations of Educational Programs, Projects and Materials, New York: McGraw-Hill
[125]Joint Committee on Standards for Educational Evaluation(1994) The program evaluation standards (2nd ed.).Thousand Oaks, CA:Sage.
[126]Kalkwijk, J.(1992) The Netherlands:The Inspectorate Perspective. In:Alma Craft (Eds.)Quality assurance in higher education:proceedings of an international Conference, (pp97-107), The Falmer Press.
[127]Karl Dittrich and Leendert Klaassen (2007) The accreditation system in The Netherlands and Flanders In Alessandro Cavalli (eds.)Quality Assessment for Higher Education, (pp115-125)Portland Press Ltd.
[128]Keun-bok Kang & Chan-goo Yi (2000, May).A design of the metaevaluation model.Poster session presented at the annual meeting of the Canadian Evaluation Society, Montreal, Canada
[129]Linstone, H.A. and Turoff, M.,(Eds.)(1975) The Delphi Method:Techniques and applications.From:http://www.is.njit.edu/pubs/delphibook/chl.html
[130]Maassen, P. A.M.(1998)Quality Assurance in the Netherlands, New Directions for Institutional Research,99,19-28,Jossey-Bass Publishers
[131]Madaus, G.F.,Scriven M.,& Stufflebeam, D.L.(1983)Evaluation Models: Viewpoints on Educational and Human Service,(pp 138-140).Klaswer N-sjhoff Publishing
[132]Maria Bustelo, Metaevaluation as a Tool for the Improvement and Development of the Evaluation Function in Public Administrations. Presentation to the 2002 European Evaluation Society. Conference.From: www.evaluationcanada.ca/txt/newsletter200409.pdf
[133]Marlene, M. Laubliloud, (2004) Setting Standards and Providing Guidelines: The Means toward What End? Evaluation,10(2),237-245
[134]Naccarella, L.,et al. (2007) Building evaluation capacity:Definitional and practical implications from an Australian case study, Evaluation Program Planning,30(3),231-236
[135]Nelson T O.(1996) Consciousness and metacognition, American Psychologist, 51(2):102-116
[136]Nilsson,N.& Hogben, D.(1983)Metaevaluation, in E.R. House (Ed.) Philosophy of Evaluation, (pp313-327). San Francisco:Jossey-Bass
[137]Nyirenda, Stanley,(1994) Assessing Highly Accomplished Teaching: Developing a Metaevaluation Criteria Framework for Performance-Assessment Systems for National Certification of Teachers, Journal of Personnel Evaluation in Education,8(3),313-327
[138]Odom, S.L.,& Fewell, R. R.,(1983)Program Evaluation in Early Childhood Special Education:A Meta-Evaluation, Educational Evaluation and Policy Analysis,5(4),445-460
[139]Operating Procedures for the Development and Approval of Standards of the Joint Committee on Standards for Educational Evaluation,2006, from: http://www.jcsee.org/wp-content/uploads/2009/09/OperProc.pdf
[140]Patel, M. (2002) A meta-evaluation, or quality assessment, of the evaluations in this issue, based on the African Evaluation Guidelines:2002, Evaluation and Program Planning 25,329-332
[141]Quality assurance in higher education in the Netherlands and Flanders, Court of Audit of Belgium-Netherlands,4 September,2008, p9
[142]Rebolloso E.,et al.(2002) Metaevaluation of a total quality management evaluation system, Psychology in Spain,6(1),12-25
[143]Russon, C. (2000) The Program Evaluation Standards in International Settings, Kalamazoo:Western Michigan University Evaluation Center
[144]Sanders, J. R.,(1994) The Process of Developing National Standards That Meet ANSI Guidelines, Journal of Experimental Education,63(1),5-12
[145]Sanders, J.R,(1999) Metaevaluation of'the effectiveness of comprehensive, case management interventions:Evidence from the national evaluation of the comprehensive child development program',American Journal of Evaluation,20 (3),577-582
[146]Schwandt, T. A.,& Halpern, E. S.(1988).Linking Auditing and Metaevaluation, (p83).Newbury Park, CA:SAGE Publications
[147]Scriven,M. S.(1969).An introduction to meta-evaluation. Educational Products Report,2,36-38
[148]Scriven, M.(1972).An introduction to meta-evaluation. In P. A. Taylor,& D. M. Cowley (eds.).Readings in curriculum evaluation(pp84-86).Chicago: University of Chicago.
[149]Scriven, M.(1974). Evaluation perspectives and procedure, In W. J. Popham (Ed.) Evaluation in education:current applications, (pp3-33),Berkeley, CA: McCutchen.
[150]Scriven M.(1975) Evaluation Bias and Its Control, from: http://www.wmich.edu/evalctr/pubs/ops/ops04.pdf
[151]Scriven, M(1981).Evaluation Thesaurus.(pp43-45) CA:Edge Press.
[152]Smith,N. L.(1981)Criticism and Meta-Evaluation. In N. L. Smith(Ed.)New Techniques for Evaluation (pp266-273)Newbury Park, CA:SAGE Publications.
[153]Stufflebeam, D.L.(1974) Toward a Technology for Evaluating Evaluation (ERIC Document Reproduction Service No.ED090319)
[154]Stufflebeam, D.L(1981)Metaevaluation:Concept, Standards, and Uses. In R. A. Berk (Eds.),Educational Evaluation Methodology:The State of The Art (ppl46-163).Baltimore, MD:Johns Hopkins University
[155]Stufflebeam, D.I.(1982) A Next Step:Discussion to Consider Unifying the ERS and Joint Committee Standards, In P. H.Rossi (Eds.)Standards for Evaluation Practice, pp30-31
[156]Stufflebeam,,D.L.& Shinkfield,A.J.(1985) Systematic Evaluation:A self-instruction guide to theory and practice. (pp68-76)Boston:Kluwer-Nijhoff.
[157]Stufflebeam, D.L. (2000).The methodology of metaevaluation. In D.L. Stufflebeam, G.F. Madaus & T.Kellaghan. Evaluation models:Viewpoint on educational and human services evaluation. (2nd ed.), (pp458-471).Boston: Kluwer
[158]Stufflebeam, D.L. (2001)The Metaevaluation Imperative, American Journal of Evaluation,22(2),183-209
[159]Stufflebeam, D.L. (2004) A Note on the Purposes, Development, and Applicability of the Joint Committee Evaluation Standards, American Journal of Evaluation,25(1),99-102
[160]Stufflebeam, D.L. and Shinkfield,A.J.(2007) Evaluation Theory, Models,& Applications.(p647).San Francisco:CA. Jossey-Bass.
[161]The draft of program evaluation standards, From: http://www.wmich.edu/evalctr/jc/
[162]Thompson, B.(2004) The revised program evaluation standards and their correlation with the evaluation use literature, Journal of Experimental Education, 63(1),54-82
[163]Uusikyla, Petri,& Virtanen, Petri (2000) Meta-Evaluation as a Tool for Learning: A Case Study of the European Structural Fund Evaluations in Finland, Evaluation,6(1),50-65
[164]Walberg, H.J.& Haertel, G. D. (eds.)(1990) The international encyclopedia of educational evaluation, (pp229-230). Oxford:Pergamon Press,
[165]Widmer, T,(2004) The Development and Status of Evaluation Standards in Western Europe, New Directions for Evaluation,104,31-42
[166]Worthen,B.S..(1974)A Look at the Mosaic of Educational Evaluation and Accountability, from http://www.eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/ 36/dd/e0.pdf