Pages

April 21, 2019

Data-Mongering (2): Algorithms and Agency, GIGO, and more

This is my second of these round-ups; you can see them all here: Data-Mongering Round-Ups. I'm also annotating as I go in Diigo, so you can the Diigo files here: Data-Mongering articles. The editorial comments there are just copied-and-pasted from the blog posts.

It's depressing to keep on reading and learning about this, but especially now that I'm reading Shoshana Zuboff's The Age of Surveillance Capitalism, I can see that the shift is happening at Instructure just as it has in one company after another: under their new CEO, Instructure has realized that its "collateral" data can actually be commodified, turning user behavior into the product that is being sold (Soylent Canvas). Who would have thought that the main outcome of the digital revolution in education would be the triumphant return of behaviorism...? Eegad. Skinner would be so happy. And I am not.

Anyway, here are some of the things I read this week that made me stop and think:


Postdigital: 10 years later, Algorithms and Agency by Lawrie Phipps. This piece gets at so many of my deep concerns right now, and it's "looking back" perspective to 10 years ago shows what a dramatic shift there has been in the normalizing of expansive digital networks, both good and bad. For example, re: TurnItIn and their ilk: "Would the sector have been so fast to sign up to a plagiarism service 10 years ago, if they had known all the student IP would one day be the property of a publishing company?" I too was wildly naive 10 years ago, and guilty of some techno-evangelism I guess. I still love teaching online, but more and more I see the technological space in which I am supposed to do my work (Canvas) as being a threat, not a resource. quote "The naive utopia we described in our 2009 postdigital paper probably only exists in the minds of idealists and tech evangelists. People have designed digital tools, platforms, and other environments with political and financial motives. In our current postdigital world, digital does not serve the social, but through the manipulation of people, it is driving a particular kind of society, one that exploits the weaknesses and and fears of people; enables the rise of racism and xenophobia, and intensifying inequality."

Why ‘learning analytics’? Why ‘Learning Record Stores’? by Donald Clark. I don't always agree with Donald Clark, but I think he is spot on in his criticism of learning analytics hype here: "Perhaps the best use of data is dynamically, to create courses, provide feedback, adapt learning, text to speech for podcasts and so on. This is using AI in a precise fashion to solve specific learning problems. The least efficient use of data is storing it in huge pots, boiling it up and hoping that something, as yet undefined, emerges" (that last bit sounds just like the pie-in-the-sky claims by Instructure's CEO that just because they have lots of data they can get lots of use out of it). Specifically on AI and learning behavior: "Recording what people just ‘do’ is not that revealing if they are clickthrough courses, without much cognitive effort. Just showing them video, animation, text and graphics, no matter how dazzling is almost irrelevant if they have learnt little. This is a classic GIGO problem (Garbage In, Garbage Out)."

One Way to Reduce Gender Bias in Performance Reviews by Lauren Rivera and AndrĂ¡s Tilcsik. This is a fascinating piece at Harvard Business Review that warns us to be suspicious of any measurement because the measuring stick itself shapes the data in ways that we never realized or intended, like the way that women are more discriminated against if you use a 10-point rating scale as opposed to a 6-point scale. So, before we start measuring everything, we need to stand back and think about the prejudices that are going to inform/deform every supposedly objective measurement we make.


Institutions’ Use of Data and Analytics for Student Success by Amelia Parnell, Darlena Jones, Alexis Wesaw, and D. Christopher Brooks. This is part of an Educause research project, and it's a good reference point for the ways that schools are trying to use data to improve student success. It is such a slippery slope, and insofar as these systems rely on numbers, and grades in particular, I am dubious. My main concern, though, is the fact that in their eagerness to run their own data experiments, schools have given companies like Instructure way too much freedom to commodify and monetize that student data for purposes that go far beyond any local initiative. From this report, I learned that my school is not alone in a strong focus on first-year retention, and the report also shows that efforts are instead going to advising, tutoring, and counseling, which is again the case at my school. IMO we need to focus on the direct educational mission, in my opinion, not just on ancillary supports. Sadly, the report does not recommend strengthening faculty role or involvement, instead the recommendation is to "identify and expand institutionally appropriate roles for IR, IT, and student affairs." But there was also this bizarre quote plunked down in the middle of the discussion of admin and support services: "As algorithms become more sophisticated, there will increasingly be opportunities for faculty to become more engaged in the delivery of interventions." The one bright spot was this recommendation: Recommendation 4: Increase the use of qualitative data, especially from students. Yes, I say, yes! Student voices please!

Developing Minds in the Digital Age: Towards a Science of Learning for 21st Century Education. Big book (250 pages) from Patricia Kuhl et al. at OECD, which I learned about from Ben Williamson at Twitter. I haven't read the book yet; I was really struck, though, by the capitalization of Big Data and Artificial Intelligence as if they were gods or something; what's up with that??? This image is from Ben Williamson's tweet:


Anyway, the book looks useful, and I will give it a read this summer. 


Insurers Want to Know How Many Steps You Took Today by Mark Raymond. I already knew a lot of the content covered here in the NYTimes article from reading Cathy O'Neil's Weapons of Math Destruction, and the whole "health management" business shows just what dangers await us in the "learning management" business: "As machine learning works its way into more and more decisions about who gets coverage and what it costs, discrimination becomes harder to spot." College pricing is already a nightmare (sticker price, as it were, versus what individual students end up actually paying). That's just one nightmare scenario I can see playing out in future, as colleges become increasingly convinced, rightly or wrongly, that they can predict accurately just how students are going to perform (and creating self-fulfilling prophecies as a result of the biases that they institutionalize in this way...).

And from @YujieXuett, a screenshot (which of course I cannot read) of data-mongering in Chinese schools:



April 14, 2019

#TotalCoLearner: a great semester of Hanuman learning

I wrote my first data-mongering round-up yesterday and did a lot of reading on predictive analytics in education... and ugh, it's all worse than I expected. But learning is good, and the better informed I become, the more I useful I can be in voicing opposition to this dehumanized education.

Meanwhile, before the weekend runs away, I wanted to write up something about the #TotalCoLearner experiment this semester in Indian Epics, because it has gone GREAT. I've got a series of #TotalCoLearner posts over at my Canvas blog, plus tweets, but this is my first post here about #TotalCoLearner, and it's perfect timing since I just wrote my last story of the semester yesterday, and I'll be wrapping up the class soon, finishing up early as some of my students do too.

So, what is #TotalColearner? The idea is that I do the whole course just like a regular student! That means you can see my course blog, just as the students each have their own blog, and I also have a course project website, just as the students do. One of the best things about all of this is that students comment on my blog and on my website at random just like they comment on the work of other students at random. And yes, they are surprised to find out that I am a student in the class, and it's kind of a weird surprise, but a good one; you can see their comments on my Introduction post this semester here. You can also see their comments on my project at the Comment Wall.

I keep track of my progress as the students do, although I use a spreadsheet instead of the Canvas Gradebook... and, honestly, I feel badly about how clunky and primitive the Canvas Gradebook is; the spreadsheet I use is way more easy to configure based on the different ways I want to check my progress (by date, by type of assignment, by my plan for finding up, etc.). For example, you can see here that as one of the few assignments I have left to do, there's one I should do today, which is writing up a famous last words post. I'll do that after I finish this post.


The nature of the course design means I really can do everything exactly as the students do; I don't have to "pretend" anything... I can just be myself. Admittedly, I'm not a typical student, but the whole point of my course design is that there is no "typical" student. Instead, every student shows up here with their own background and interests, their own skills and gaps, their own goals and priorities. Based on all that, each person is choosing what they want to read and write and other work that they do for the class, week by week, sharing their work via their blog and their website. It's because I can choose that I am able to adapt the class to suit my learning needs and goals, and the students are also doing the same thing for their own needs and goals.

The only difference between my work for the class and what the students are doing is that I can't do the weekly "project feedback" assignments because I do feedback already on all the projects every week as part of my job as a teacher. So, no worries: I just replace that assignment with other optional assignments, mixing-and-matching from the available assignments just like the students also do based on what assignments they choose to do (or not). This semester I did extra credit reading posts because I was reading a ton of stuff.

And as a result, oh my gosh, I LEARNED SO MUCH. And that's because I set myself a really cool and new challenge: I immersed myself in the version of the Ramayana from Thailand known as the Ramakien, and I also gave myself a crash course in the arts of Thailand that are inspired by Rama's story (Khon theater masks, temple sculptures, so much beautiful stuff). I've always known about the Ramakien's existence before, and I knew about Suvannamaccha, Hanuman's mermaid lover... but that's all. I had never read the whole thing. So, this semester, I read the whole thing! (In a terrible translation, but alas, there is no good English translation of the Ramakien.)

So, just like the students, I posted my reading notes week by week on the Ramakien (and I also re-read Chitra Divakaruni's Mahabharata novel, Palace of Illusions, plus I read Samhita Arni's new novel based on the Silappadikaram, a south Indian epic; more about that here). For Tech Tip extra credit, I built some randomizing image widgets with Hanuman art from India and from South Asia, and I even learned how to embed image randomizers into a Google Sites page! On the writing side, I also pushed myself in new ways so that the project I ended up writing was actually not an anthology (my usual writing approach), but a true extended narrative that ended up wrapping around at the end back to where I started, with a Ramakien-inspired story about Hanuman's mother to which I added my own big reveal at the end; that's the story I wrote yesterday: Hanuman and Pirakuan. Figuring out how that story would work may be the biggest writing thrill I've ever had... I'm so proud of figuring out how to bring Hanuman's mother back around into the story there at the end. (And, yes, that means my project ending up being centered on women's stories, which is a theme that comes up again and again in student projects in the class too, finding ways to decenter the men's stories so that we can bring more women's voices into the epic world.) I also wrote some stories here at the blog separate from the project that I was really proud of, especially my story about Mandodari, plus one about Arjuna and Hanuman.

So, for finishing up the class, I need to add that final Hanuman-and-Pirakuan story to my Storybook website, as well as adding another image gallery page to the site, along with some wrap-up posts at the blog, which I'll probably do next weekend. And while I will be sad to end this particular learning adventure (there is so much more I still want to learn about the south Asian Ramayana!), I am also so excited about what I will do for the Myth-Folklore class next semester. I've got a huge (HUGE) Brer Rabbit project that I began over winter break, and that is what I am going to use to ignite my participation in the Myth-Folklore class in the Fall.



And yay Brer Rabbit too! :-)