Pedagogical Approaches and Google LM Notebooks

Some ten or so years ago myself and Jenny Hughes were commissioned by Lifelong Learning UK to produce a Literature review on Pedagogic approaches to using technology for learning. As Wikipedia explains, Lifelong Learning UK (LLUK) was one of the independent, Sector Skills Councils (SSCs) for UK employers in the lifelong learning sector. It was responsible for the professional development of all those working in community learning and development, further education, higher education, libraries, archives and information services, and work based learning across the UK.

As has arisen in the recent debate over the new Labour Government's establishment of SkillsUK, there is a long tradition in UK education of setting up new agencies and organizations, only to abandon them after a few years. Anyway just after our report was published LLUK were shut down. Even so, the report continued to be accessible from ResearchGate and other sites and has over the years gained a respectable number of downloads.

In the last couple of days I have been playing with the Google Labs experimental NotebookLM. I am normally rather under impressed by AI applications built for education but I can see a lot of use for this. It is backed by the Gemini Large Language Model but the Notebooks are based, they say only on data sources which you provide. And then there are different tools which can be used to support your research.

The Literature Review on Pedagogic approaches was a fairly dense piece of work and seemed to me a good example for playing with. I uploaded the 80 page report as a PDF and it gave me teh follwing summary.

This source is a literature review entitled "Pedagogic approaches to using technology for learning", which explores the evolving landscape of technology-enhanced learning. The authors, Graham Attwell and Jenny Hughes, argue that the proliferation of new technologies and internet tools is fundamentally changing the way we learn. They identify key themes driving this change, including the increasing role of digital literacies, the shifting expectations of learners, and the need for new pedagogic models. The review delves into specific pedagogic theories and their implications for using technology, highlighting frameworks like constructionism, activity theory, communities of practice, and Vygotsky's social constructivism.

The document examines the impact of technology on pedagogy in practice, exploring the rhetoric-reality gap and highlighting challenges such as the mismatch between students' digital skills outside school and their limited use within the formal learning environment. They discuss the emergence of personal learning environments (PLEs) as a potential solution to this challenge, and analyse the impact of emerging technologies like Web 3.0 and mobile devices on learning. The authors also examine the role of teacher training and professional development in adapting to this changing technological landscape, highlighting the critical need for training that focuses on pedagogic approaches rather than just technical skills. The review concludes by identifying gaps in existing research, underscoring the need for further investigation into the impact of technology on student performance, the development of evaluation tools specific to e-learning, and the exploration of culturally-specific influences on ICT integration.

Pretty smart although you wold expect an advanced Generative LLM to be able to do that. But you can also ask questions and it suggests examples - for instance "Describe the evolution of digital literacy understandings as outlined in the text." I just uploaded the one report but it could get much more interesting with multiple documents.

Anyway on to the killer feature which may turn out just to be a gimmick. You can ask it to produce a podacst in which two different 'people' discuss your work. And I love it. It has some of the baest explanations of Activity theory, constructionism and Vygotsky's theory of the Zone Proximal Development I have ever heard. Anyway do listen. Although ten years old, I think the pedagogic approaches outlined in chis paper stand the test of time - even more I think they are highly relevant for the debate over AI and the podcast makes the work far more approachable. But if you dco what the original report it is downloadable here.

AI: education and learning are not the same thing

Rick Payne and team / Better Images of AI / Ai is… Banner / CC-BY 4.0

As the debate rolls on about the use of AI in education,we seem stuck on previous paradigms abut how technology can be used to support the existing education system rather than thing about AI and learning. Bill Gates said last week "The dream that you could have a tutor who’s always available to you, and understands how to motivate you, what your level of knowledge is, this software should give us that. When you’re outside the classroom, that personal tutor is helping you out, encouraging you, and then your teacher, you know, talks to the personal tutor." This can be seen in the release of Apps designed to make the system run more efficiently and support teachers in producing lesson plans, reduce administration etc. And for learners a swath of tutor apps and agents to help navigate the way through to support skills and knowledge development.

But writing about the popular educational exercise of future forecasting in the European Journal of Education in 2022, Neil Selwyn outlined five broad areas of contention that merit closer attention in future discussion and decision-making. These include, he said:

(1) "taking care to focus on issues relating to 'actually existing' AI rather than the overselling of speculative AI technologies;

(2) clearly foregrounding the limitations of AI in terms of modelling social contexts, and simulating human intelligence, reckoning, autonomy and emotions;

(3) foregrounding the social harms associated with AI use;

(4) acknowledging the value-driven nature of claims around AI; and

(5) paying closer attention to the environmental and ecological sustainability of continued AI development and implementation."

In a recent presentation, Rethinking Education, rather than predicting the future of technology in education, Ilkka Tuomi reconsiders the purpose of AI in education which he says "changes knowledge production and use. This has implications for education, research, innovation, politics, and culture. Current educational institutions are answers to industrial-age historical needs."

EdTech he says, has conflated education and learning but they are not the same thing. He quotes Biesta(2015 who said "education is not designed so that children and young people might learn –people can learn anywhere and do not really need education for it –but so that they might learn particular things, for particular reasons, supported by particular (educational) relationships.” (Biesta, 2015)

He goes on to quote Arendt (2061) who said “Normally the child is first introduced to the world in school. Now school is by no means the world and must not pretend to be; it is rather the institution that we interpose between the private domain of home and the world in order to make the transition from the family to the world possible at all. Attendance there is required not by the family but by the state, that is by the public world, and so, in relation to the child, school in a sense represents the world, although it is not yet actually the world.”

Education 4.0 he says is supposedly about “Preparing children for the demands of the future. "Education becomes a skill-production machine." Yet "Skills are typically reflections of existing technology that is used in productive practice and "Skills change when technology changes." Tumomi notes "There are now 13 393 skills listed in the European Skills, Competences, and Occupations taxonomy."

Digital skills are special, he says "because the computer is a multi-purpose tool" and "AI skills are even more special, because they interact with human cognition."

Social and emotional “skills” rank-order people“. "'21st century skills' are strongly linked to human personality, which, by definition, is stable across the life-span and People can be sorted based on, e.g., “openness to experience,” “conscientiousness,” “agreeableness,” “verbal ability,” “complex problem-solving skills,” etc."

Their position is these list doesn’t change in education and "Instead, training and technology potentially increase existing differences.|"

Tuomi draws attention to the the three social functions of education:

  • "Enculturation: Becoming a member of the adult world, community of practice, or thought community
  • Development of human agency: Becoming a competent participant in social and material worlds with the capability to transform them
  • Reproduction of social structures: Maintaining social continuity; social stratification through qualification and social filtering'
  • AI in education supports Enculturation through:
  • "AI for knowledge transfer and mastery
  • Development of human agency
  • AI for augmentation of agency
  • Reproduction of social structures
  • AI for prediction and classification (drop-out / at-risk, high-stakes assessment)Incentives and motives in HE."

But while "Students used to be proud to be on their way into becoming respected experts and professionals in the society which For many families, this required sacrifice they are now facing LLMs that know everything." Why, he asks "should you waste your time in becoming an expert in a world, where the answers and explanations become near zero-cost commodities?" What happens to HE, he ask, "when AI erodes the epistemic function of education? The traditional focus of AI&ED in accelerating learning and achieving mastery of specific knowledge topics is not sustainable"

His proposal is that "The only sustainable advantage for primary and secondary education, will be a focus on the development of human agency. Agency is augmented by technology. Agency is culturally embedded and relies on social collaboration and coordination. Affect and emotion are important and the epistemic function will be increasingly seen from the point of view of cognitive development (not knowledge acquisition). Qualification has already lost importance as the network makes history visible. It still is important for social stratification (in many countries)."

He concludes by reiterating that "Education is a social institution. It should not be conflated with 'learning'. AI vendors typically reinterpret education as learning. Education becomes “personalized” and “individualized,” and the objective changes to fast acquisition of economically useful skills and knowledge. The vendors are looking for education under the lamp-post, but this lamp-post is something they themselves have set up. Very little to do with education."

AI in ED: Equity, XAI and learner agency

Alexa Steinbrück / Better Images of AI / Explainable AI / CC-BY 4.0

The AI in education theme continues to gather momentum, resulting in a non stop stream of journal; articles, reports, newsletters. blogs and videos. However, while not diminishing, there seem to be some subtle change in directions in the messages.

Firstly, despite many schools wary of Generative AI, there is a growing realisation that students are going to use it anyway and that the various apps claiming to check student work for AI simply don't work.

At the same time, there is an increasing focus on AI and pedagogy (perhaps linked to the increasing sophistication of Frontier Models from Gen AI but also the realisation that gimmicks like talking to an AI pretending to be someone famous from the past are just lame!). This increased focus on pedagogy is also leading to pressure to involve students. in the application of Gen AI for teaching and learning. And at recent students two ethical questions have emerged. The first is unequal access to AI applications and tools. Inside Higher Ed reports that recent research from the Public Policy Institute of California on disparate access to digital devices and the internet for K-12 students in the nation’s largest state public-school system. Put simply, they say. students who are already at an educational and digital disadvantage because of family income and first-generation constraints are becoming even more so every day as their peers embrace AI at high rates as a productivity tool—and they do not.

And while some tools will remain free, it appears that the most powerful and modern tools will increasingly come at a cost. The U.K. Jisc recently reported that access to a full suite of the most popular generative AI tools and education plug-ins currently available could cost about £1,000 (about $1,275) per year. For many students already accumulating student debt and managing the rising cost of living, paying more than $100 per month for competitive AI tools is simply not viable.

A second issue is motivation and agency for students in using AI tools. It may be that the rush to gamification, inspired by Apps like DuoLingo, is running thin. Perhaps a more subtle and sustained approach is needed to motivate learners. That may increase a focus on learner agency which in turn is being seen as linked to Explainable AI (or XAI for short). Research around Learning Analytics has pointed to the importance of students understanding the use purpose of LA but also being able to understand why the Analytics turns out as it does. And research into Personal Learning Environments has long shown the importance of learner agency in developing meta-cognition in learning. With the development of many applications for personalized learning programmes, it becomes important that learners are able to understand the reasons for their own individual learning pathways and if necessary challenge them.

While earlier debates about AI in Ed ethics, largely focused on technologies, the new debates are more focused on practices in teaching and learning using AI.

GenAI and Assessment

As a recent publication from the Universitat Oberta de Catalunya points out, Artificial Intelligence remains an opportunity (or an excuse) to transform assessment, curriculum, teaching, personalization and teaching competencies. This is especially so in relation to assessment with widespread concern in the academic world about the near impossibility of detecting whether or not a student has used generative AI in an assignment.

The Universitat Oberta de Catalunya article explores the potential of continuous assessment aimed at self-regulation of learning. It suggests changing the assessment approach, moving from criteria focused on the assessment of the result to criteria focused on the process of development of the activity by the students.

    Furthermore it advocates designing continuous assessment activities as part of the same learning sequence, with relationships of dependency and complementarity, instead of discrete tests and focusing the activities on the development of competencies and the assessment of progress and reflection on the learning process of each student.

    Leon Furze is a prolific contributor to LinkedIn and describes his work as "Guiding educators through the practical and ethical implications of GenAI. Consultant & Author | PhD Candidate."

    Witting from the perspective of education in Australia he says:

    When it comes to GenAI, much of the conversation in education has been focused on academic achievement, perceived threats to academic integrity, and the risk that this technology poses to written assessments. I think that vocational education actually offers some fantastic alternative forms of assessment which are less vulnerable to generative artificial intelligence. If you’re not familiar with vocational education, assessments are often incredibly rigorous, sometimes to the point where the paperwork on evaluation and assessment is significantly longer than the assessment itself.

    Vocational training, by nature, is practical and geared around skills which are needed for the particular job role or discipline being studied. Mainstream education, by contrast, is focused predominately on subjects and content.

    Furze provides examples of different types of assessment in vocational educati9n and training:

    • Observation checklists
    • Role plays
    • Scenarios
    • Workplace activities
    • Reports from employers

    He has prublished a free 60 page ebook - Rethinking Assessment for GenAI which he says covers everything from ways to update assessments, to the reasons I advise against AI detection tools. 

    Designing new social AI systems for education

    UNESCO-UNEVOC/Ludi Yana under CC BY-NC-SA 4.0 IGO

    Very much like the conclusion to Mike Sharples paper, 'Towards social generative AI for education: theory, practices and ethics':

    Designing new social AI systems for education requires more than fine tuning existing language models for educational purposes. It requires building GAI to follow fundamental human rights, respect the expertise of teachers and care for the diversity and development of students. This work should be a partnership of experts in neural and symbolic AI working alongside experts in pedagogy and the science of learning, to design models founded on best principles of collaborative and conversational learning, engaging with teachers and education practitioners to test, critique and deploy them. The result could be a new online space for educational dialogue and exploration that merges human empathy and
    experience with networked machine learning.