平凸杂谈

才高五斗不觉耻,水灌一坛只作痴。凸情不枉君付意,子志难琢我化石。
个人资料
贾平凸 (热门博主)
  • 博客访问:
正文

美国教育系列之二:被榜单改变的美国教育

(2021-05-01 12:17:21) 下一个

Video Script:

Year of 1983. Reagan Administration. A report from US Department of Education dropped a bombshell on American public. The shock, if taken in retrospect, is worse than Gagarin’s space travel two decades ago. “For the first time in the history of our country, the educational skills of one generation will not surpass, will not equal, will not even approach, those of their parents.”

Ripples of education reforms were instigated combating the American education’s sliding trend. Riding in Reagan’s era of deregulation, charter school made into the state and national discussions. When the State of Minnesota became the first to allow charter schools, a national curriculum for K-12 was yet an awareness of Janet Napolitano, the recently resigned president of University of California system whose last action is to obsolete SAT in admission. Napolitano, chairing National Governors Association in 2009, incubated the Common Core State Standard that regulates today’s classrooms. One of her recruits for Common Core development, David Coleman, is now the CEO of a known education duopoly, the College Board.

Yet, one thing came along with the reforms was rather innovative. It is the first of all College Rankings that we are today indulged with, the US News & World Report Best Colleges. In 1983, Mel Elfin took the responses from 1300 colleges to his uniform questionnaire and scored them in respects such as academic, faculty, and student qualities. Questionnaire has since become de facto standard of obtaining information for rankings. Along become norms are the club of four elite colleges that have always occupied the top of the rankings, Harvard, Yale, Princeton and Stanford. Others occasionally atop seem decorations to the Ranking’s claims on its fairness and diversity. Technology advances soon enabled Elfin to reproduce this bi-annual ranking yearly.

Since Education for Economic Security Act in 1984 was enacted, Americans have seen one major education law every two years. Like EES’1984, every of the new laws stressed on the vital improvement on math and science capacities, imperative equality of education among students, and satisfactory measurements of teaching and learning progress. No Child Left Behind Act of 2001 mandated standard-based yearly results especially among the disadvantaged and disabled. Every Student Succeeds Act of 2015 stepped forward in requiring periodic standardized tests, either proprietary designed or commonly adopted. Yes, the SAT is included.

As popularity of college rankings grew, the mechanism evolved. Elfin’s scoring seems too subjective. Robert Morse brought a new way that sorts and weighs information in a more sophisticated framework. Forging the algorithm into quantitative fashion, Morse has since presided the US News’ ranking team. Data sourcing diversifies too. Unlike a dozen of agencies that replicated US News, College Prowler emerged in 2002 with user generated content and a layered algorithm. Originally developed as a class project at Carnegie Mellon, it expanded into a household name known as Niche in just a few years, which today ranks and rates in as many areas as US News does.

Reform after reform, Americans only see their children’s academic performance lowered than many other countries. PISA, a well-known tri-annual cross-national tests on reading, mathematical and scientific literacy among 15-year-olds in some 70 developed and developing countries, placed the U.S. an unimpressive 38th in math and 24th in science. Among the 35 members of the OECD that sponsors the PISA initiative, the U.S. ranked 30th in math and 19th in science. The well-intentioned politically-crafted reforms have not saved the American children.

The year that a college appear on the ranking correlates with its positions. Duke ignored Elfin’s call in 1983 and attended him two years later. John Hopkins followed suit even later, in 1988. The two southern colleges have averaged at 7th and 14th respectively. UCLA commenced in the questionnaire in 1989, and was locked between 20th and 30th. Its sister school, Berkeley, instead, boarded since inception, and made steadily 3-6 spots better.

Our rankings dictate a world of colleges, so do our colleges dominate the world. According to US Department of Education’s Open-Door Report, America is the most wanted place for study abroad, housing over 1 million foreign students. Domestically, when recruiting letters from Harvard, Duke, and Berkeley keep flooding our mail boxes, we fantasize that our kids matriculate to the colleges that a whole world wants.

Despite reforms on state and federal curriculums, assessments, and budgeting, our struggles at K-12 have never lessened. Lowered student competence in math, science, and even reading is now multiplied by lacking of teachers as well as draining on public education investment. Metropolitan schools are closed, and suburban schools are consolidated. No doubt that a third of American high school seniors every year graduate unable to score a minimum of 25% questions in a four-choice standardized test. In other words, they are beaten by a rolling dice.

A global dominance of American colleges, though, has been buttressed by floods of intellectual and financial resources, thanking to their reputations casted in the fantasy of college rankings. Nearly 40 years passed the creation of college ranking, the interest to rank colleges has expanded to everywhere in the global market. Times, Newsweek, Quacquarelli Symonds, and dozens of others populate the game field. Yet, US News Best Colleges remains the most known, and HYPS go on most wanted.

Lacking of mathematical and scientific delicacy throughout their childhoods, will Americans in 21st century made into Mars as we, their parents and grandparents are wishing?

 

附:榜。江湖。

时间回到1983年。里根,首任,第三个年头。美国人民心里是很纠结的,但不是因为总统是否靠谱。教育部的一篇报告,把美国人民充值了30多年的自豪感摔到谷底。这篇题为 《国家危机》的报告,一开头就列举13项危机标志,指明美国正处于一场前所未有教育危机之中。简而言之,那些含苞待放的和正在开放的花朵们的教育水平达到战后三十多年来的最低。一场教育改革看来是必然的了。

三十年过去了,美国基础教育的学生水平并没有多大改观。但这根本不妨碍美国巩固并扩大自己在全球教育市场上的统治地位。这一切,得益于三十年教育改革的一个副产品-学校排行榜。手里有榜,全世界都得向美国学习。

美国新闻:问卷调查和权重算法

做学校榜最早和最有名的,是美国新闻和世界报道(简称美国新闻)。世界上有大学文凭的人,可以没看过美国新闻杂志,但不可能没听说过美国新闻大学榜。当年,想到这个主意的是Mel Elfin,时任Washington Bureau社长。手里有数据的Elfin跟美国新闻杂志社一拍即合。第一期大学榜就这么出来了。当时的Elfin,还不知道什么算法。他靠向1300多个高校校长发出调查问卷,搞得像《我是歌手》的选手内投一样。校长们在问卷中在课程、教授、学生和学术综合等四个方面对其他大学打分评价。Elfin再从中算出各大学的平均得分。这期排名,确定了问卷调查模式在榜江湖的正统地位。

第一期问卷调查号称1300个学校,但实际回复率并不高。杜克、纽大、布朗、霍普金斯和宾大等都没有理会Elfin。但榜单一出,他们就都明白自己错了。在榜单出炉的三年之内,所有后来雄霸此榜的前20的大学,都纷纷投向Elfin了。如果谁在1986年还没有决定填写这份调查问卷的话,那他就永远没可能挤进榜单的Top 20了。事实上,那些1986年的时候还坚持忽视Elfin的大学,他们在后来榜单上的最高排名是第29名(这是大名鼎鼎的威廉玛丽学院,它长期徘徊在榜单的31-34名之间)。

时间进入1987年。Elfin刚忙活完第三期大学榜。前两期榜单上,哈斯普耶霸占前四。除了让哈耶并列一回第二之外,没什么变化。斯坦福连续三期为首。Elfin自己后来透露说,榜首不是哈耶普,他会不爽。Elfin这时候对自己创造的这个排榜方式有点小罪恶感 -文科生嘛,明明是主观上想作,但客观上却需要找个理由。于是,他找来了统计学家Robert Morse。由Morse主笔,对问卷所产生的越来越多的数据信息分类整理,再设置权重,最后产生一份综合榜。Elfin给Morse的自由度很大,但是唯一不放的就是榜首必须是哈耶普。于是,斯坦福再也没有登上过榜首了。

一个文科生,一个理科生,一个问卷调查搞定数据,一个权重算法给出理由,这合作没法不愉快。权重算法在榜界的江湖地位也就愉快地敲定了。尽管美国新闻榜单后来经历风风雨雨,但其江湖老大的地位却一直没人能撼动。其他的榜单,都只能从市场细分的角度入手,走差异化的战略。其中几个比较有影响的大学榜有英国泰晤士(Times),商业内参(Business Insider)、经济学人(Economist)和财富杂志。Elfin有了Morse,算法逐渐去专家化。但Business Insider站出来坚持原始方法,仍以专家意见为唯一排榜依据。而Times榜单选择在两点上进行差异化:一是国际视野,二是侧重教、研。Times对教学和科研两项分别给出30%超高权重。Economist的选择更加新奇,它寄望用学费、财政资助、和学生毕业后收入这些主要的经济指标,评价一个大学作为一项投入了金钱和四年时间的投资价值。除了这些,还有很多。众多差异化榜单的存在,给日益离不开榜的人们以更多的选择。

Niche:用户评论和分层算法

时间先快进到2002年。榜江湖迎来一个小清新。一个源自卡耐基梅隆商学院的创业课程项目College Prowler,脱离调查问卷,以互联网为基础产生榜单。2004年创始人Luke Skurman把这个项目从学校课堂独立出来,成立了Niche.com。

Niche的数据采集是典型的互联网UGC(用户产生内容)模式。浏览Niche网站的互联网用户,给网站留下大量的学校评论。评论中包含学校的学术、专业、体育、生活、文化、地理和经济等等方面的一手信息。可以说调查问卷所涉及的内容,几乎被UGC的评论都覆盖了。而评论中还有很多校方和专家们不了解的学生直观感受。更加丰富的信息,使得Niche的榜单从数据角度比美国新闻更加客观全面。这是Niche和美国新闻学校榜的本质不同。

Niche的革命性不限于数据生产的UGC模式,还引入了分层算法。分层尽管不是Niche的创造,但却是Niche最先运用到大学榜的,而且用的是统计分层。单项评分和综合评分分别进行两层统计归一,这从算法的角度看更具科学性。靠UGC评论和分层算法,Niche的评分相对美国新闻更具有客观属性。Niche的排行榜因此很快上位,成为很多互联网用户,尤其是学生和家长选校择校的必要依据之一。

说到分层算法,美国新闻其实最早在它和教育部门合作的高中榜算法中先采用了分层。不同的是,这个高中榜采用分层逻辑筛选,而不是统计归一。前两层筛,考察学校的平均成绩,第三层筛考察学校的毕业率。过筛之后,第四步,只以AP或IB考试的通过率作为排名依据。

Niche的算法更具有客观性,并不能掩盖这种排名先天的主观缺陷。事实上,Niche排名的先天缺点,正是在于它的UGC属性。评论在用户个人来说一定是非常主观片面的,只有大量独立用户评论的存在可以帮助消除这些主观片面性。不过,互联网舆论往往存在羊群效应,和主流不一致的评论就会被压制,导致评论中出现一边倒的现象。在Niche的评论页面考察一下就会发现这种情况很突出,而且不是偶然现象。另外,还有一种更糟糕的主观性,就是网络运营者的主观利益驱动。2008年就又一次被管饭媒体报道的Facebookgate事件。一名Niche员工在未经授权的情况下,在Facebook上建立了大量高校主页,并以此为渠道推广Niche。这件事被Butler University的招生主管发现后,跟踪了一年,最后迫使Facebook关闭了这些网页。(Facebook水军泛滥的例证可不只这一件,我们还记得2016年美国大选的假新闻)。

制榜和看榜,都要客观、全面

到此为止,我们把榜江湖的故事回忆了个大概。读者马上就会产生这样的问题:我们应该如何看榜才是最合适的。我从分析比较的角度,看一下榜江湖的世界观。

榜单的制作,分为数据收集和评分算法这两个步骤。数据上,一端是专家调查问卷的传统媒体模式,另一端是UGC用户评论的互联网模式。可以认为后者信息量更大更全面。当然,也有居于中间的用户调查问卷的模式。算法上,一端是各项分数依权重合成,另一端是用统计归一得出分数。可以认为统计比权重在算法上更加客观。这样比较下来,可以用下面一个简单的2 x 2空间来描述我们现在看到的各类榜单:

但是,制榜者天生就带有主观性。1996年,美国新闻由于算法调整,分离出新类指标Financial Resources,引发一轮大学不满。斯坦佛大学校长著文批评说“我们什么也没做,没有减少什么投入,其他学校也没有变化…结果却看见我们的名次掉了。我只能推断,他们把公式改了”。这句话点出了制榜的矛盾 - 唯一榜单不可能满足多数人的愿望。排在高处的人不愿意变化,排在低处的人又不愿意没变化。

人们一直都在批评美国新闻的名气因素令排名相对固定的不合理性。1999年,美国新闻曾因此换掉Morse而换上的统计学家 Graham,从纯科学意义上调整算法,造成加州理工突然冲上榜首(2000版美国新闻大学榜)。这个提高客观性的改革,结果是Graham迅速离职。

榜单天生的主观性,要用更多的客观性因素来弥补。2007年,美国文理学院组织Annapolis Group发起一场运动,号召校长们不要在理会美国新闻的问卷调查。2011年,身为藤校的康奈尔大学也研究得出结论,美国新闻榜的排名因素有明显的非理性的噪音含量。质疑存在,Morse也不得不应时而变,在调查问卷则加入更多的用户成分,诸如高中升学顾问和学生的意见。

另一方面,看榜,更是一个主观的过程。任何用户看榜的目的,只能是自身选择的合理化和利益的最大化。这本质上是个性化的需求。所以,从看榜人的立场出发,完全客观性的榜是毫无意义的。制榜者可以在数据和算法上加入更多客观性,甚至形成最客观的榜单。

作为榜的使用者,我们必须明白一个不变的真理。在选校的时候,我们是要选择一个最适合我们的学校;而在选完以后,我们要的就是让这个学校的排名最好地支持我们的满足感。从这看来,我们一定要全面的看任何一个榜单,还要尽量看全所有有意义的榜单。这样做了,我们的选校决策空间就最全面;而决策后,我们的满足感也就最大化。

[ 打印 ]
阅读 ()评论 (4)
评论
贾平凸 回复 悄悄话 务实小民2021-05-07 06:01:23
看了这篇,俺想得比较远,面临看上去公平正义的客观霸权,中国只能用打破规则耍无赖的手段对付。
----就教育、就业口,海外名校在“榨取”了多少生源/机会/优待之后,目前海归在中国的就业优势急剧下降,从天上走入了凡尘。
其他领域,也有很多类似的情况。公开搞不过,就只能掀桌子。哈哈,有意思。

回复 '务实小民' 的评论 :
感谢阅览。这篇的主题只是关注美国教育何去何从。大学排名引导了尾重头轻的教育格局,而育人重要的是人生的前几年,所谓三岁看大,七岁看老。错误的轻重格局导致了教育最终的扭曲局面。这里还有更多扭曲甚至荒谬的东西。
贾平凸 回复 悄悄话 markyang 2021-05-06 21:33:28
唯一不放的就是榜首必须是哈耶普
这种先定排名,再找规则去论证的,也是难为了统计学家,不容易呀


回复 'markyang' 的评论 :
Mel Elfin has a Master in American Civilization from Harvard in 1952. I guess that illustrates more background. Ivy League has established popular reputation much earlier than the ranking. It might be wise as well for Elfin to follow such popular views.
务实小民 回复 悄悄话 看了这篇,俺想得比较远,面临看上去公平正义的客观霸权,中国只能用打破规则耍无赖的手段对付。
----就教育、就业口,海外名校在“榨取”了多少生源/机会/优待之后,目前海归在中国的就业优势急剧下降,从天上走入了凡尘。
其他领域,也有很多类似的情况。公开搞不过,就只能掀桌子。哈哈,有意思。
markyang 回复 悄悄话 唯一不放的就是榜首必须是哈耶普
这种先定排名,再找规则去论证的,也是难为了统计学家,不容易呀
登录后才可评论.