This paper reports findings from a research study at The Open University, UK into the quality of distance learners' online exam experience and the differences in experience between online (pandemic) and in-person (pre-pandemic) modes of examination. Our research responds to the ongoing need for greater insight into the exam experience and is uniquely positioned in two ways. First, we made use of a robust reference dataset collected before the COVID-19 pandemic and compared this with a second survey administered a year after the pandemic started; second, we asked students about their experience preparing and revising for the exam as well as the exam itself. Exam revision represents an important transitional period for learners. Our results show that, overall, the shift to online remote exams did not impact the quality of distance learners' experience of revising for exams or taking the exam itself. We found no significant change in the revision experience across six of eight measures, including the learning benefits of learning while revising, enjoyment, and support. However, students reported feeling less anxious when revising for online exams. The quality of the exam experience itself was largely unaffected by the move from in - person to online remote exams. No significant differences were found for seven of the nine measures of exam experience. However, we found satisfaction with the exam environment was significantly higher for online exams and that learners felt the online exam was harder than they expected. Age and gender differences are also explored.

Comparing universities and courses is of interest to a variety of stakeholders including potential students, policy makers, news and media organisations, ranking providers, and universities themselves. There are a range of existing university ranking schemes that provide comparisons (e.g. Academic Ranking of World Universities) but typically these are designed with face-to-face teaching and learning in mind. There is also a growing number of quality assurance tools and approaches aimed at ensuring the quality of online education This article reports on an analysis of a range of quality assurance systems for online higher education institutions and courses, together with variety of ranking systems targeting conventional universities-with the aim of establishing what they measure, and the metrics used to assess quality. The findings from this analytical study were compared with a meta-analysis of the literature about how students choose their university in order to understand how these instruments influence current student opinion and can be used more proactively by universities themselves. The findings reveal: (1) current ranking systems are of limited value for most potential undergraduate students, particularly with reference to online education, (2) comparison systems that can be of value to students from a variety of different backgrounds are likely to be complex to set up and run, and (3) quality indicators that promote both formative and summative evaluation may be beneficial to both institutions and students.

University ranking systems are being implemented with the aim of assessing and comparing higher education institutions at a global level. Despite their being increasingly used, rankings are often strongly criticized for their social and economic implications, as well as for limitations in their technical implementation. One of these limitations is that they do not consider the specific characteristics of online education. This study used a participatory approach to define a set of criteria and indicators suitable to reflect the specific nature of distance education. This endeavour will help evaluate and rank online higher education institutions more appropriately than in current practice, where indicators are devised for traditional universities. To this end, several stakeholders and informants were involved in a Delphi study in an attempt to reach the broader higher education institutions (HEI) community. According to the study participants, apart from students’ achievements and general quantitative measures of HEI performance, which are quite common in traditional ranking systems, teaching and student learning experience turned out to be the most important criteria. Student support, teacher support, technological infrastructure, research and organization were deemed middle ground criteria, while sustainability and reputation were regarded as the least important criteria.

Learning analytics involve the measurement, collection, analysis, and reporting of data about learners and their contexts, in order to understand and optimise learning and the environments in which it occurs. Since emerging as a distinct field in 2011, learning analytics has grown rapidly, and early adopters around the world are already developing and deploying these new tools. This paper reports on a study that investigated how the field is likely to develop by 2025, in order to make recommendations for action to those concerned with the implementation of learning analytics. The study used a Policy Delphi approach, presenting a range of future scenarios to international experts in the field and asking for responses related to the desirability and feasibility of these scenarios, as well as actions that would be required. Responses were received from 103 people from 21 countries. Responses were coded thematically, inter-rater reliability was checked using Cohen’s kappa coefficient, and data were recoded if kappa was below 0.6. The seven major themes that were identified within the data were power, pedagogy, validity, regulation, complexity, ethics, and affect. The paper considers in detail each of these themes and its implications for the implementation of learning analytics.

University ranking systems are being implemented with the aim of assessing and comparing higher education institutions at a global level. Despite their being increasingly used, rankings are often strongly criticized for their social and economic implications, as well as for limitations in their technical implementation. One of these limitations is that they do not consider the specific characteristics of online education. This study used a participatory approach to define a set of criteria and indicators suitable to reflect the specific nature of distance education. This endeavour will help evaluate and rank online higher education institutions more appropriately than in current practice, where indicators are devised for traditional universities. To this end, several stakeholders and informants were involved in a Delphi study in an attempt to reach the broader higher education institutions (HEI) community. According to the study participants, apart from students' achievements and general quantitative measures of HEI performance, which are quite common in traditional ranking systems, teaching and student learning experience turned out to be the most important criteria. Student support, teacher support, technological infrastructure, research and organization were deemed middle ground criteria, while sustainability and reputation were regarded as the least important criteria.

This paper describes the development of a new methodology for learning design. Our approach is predicated on the view that no one, simple, view of design is appropriate, because of the inherently messy and creative nature of design. Instead we are adopting an interactive and multi-faceted approach which consists of a series of cycles of user consultation, focus groups and workshops alongside the development of learning design tools and resources. In particular we will describe how we have adapted an existing mind mapping and argumentation tool, Compendium, so that it can be used as a means of guiding designers through the learning design decision making process in the creation of learning activities. We will describe the initial evaluations of the use of this tool, along with our findings to date on a series of fact finding exercises to better understand individual and team approaches to design.

Being able to compare effectively universities and their courses is of particular interest to a wide range of stakeholders - including potential students, policy makers, media organisations, funders, and universities themselves. There does exist a range of university ranking schemes (for example, the Shanghai Academic Ranking of World Universities) that enable some level of comparison but these systems and the metrics that they use are sometimes limited and often controversial. In addition, of particular interest to the Open University, one of the world's largest online universities, these widely-used ranking systems are designed for face-to-face teaching and learning universities, such that their metrics can be inappropriate for online distance universities. In our paper, we will discuss work that we have undertaken to date towards the establishment of a ranking system that includes indicators of the quality of online distance teaching and learning, to enable the effective comparison of online distance universities. The work reported was completed in the first 8 months of the EU Erasmus+ funded CODUR project with partners from Universitat Oberta De Catalunya (Barcelona, Spain) and Consiglio Nazionale Delle Ricerche (Genova, Italy).

This editorial introduces the JIME special collection looking at ‘Migrants, education and technologies’.

The challenge of supporting immigrant language-learning and social integration has increased recently, leading to initiatives and projects that aim to provide assistance, including using smartphones in the course of daily activities. However, most of the Mobile Assisted Language Learning (MALL) literature focuses on classroom based learning thereby leaving a gap in understanding the learning in informal settings. This paper discusses a UK field trial of the European funded MASELTOV project, which developed a suite of smartphone tools and services (the 'MApp') to help immigrants' language learning and social inclusion in four European cities. MApp tools and services include language lessons designed to assist informal learning in everyday life, focusing on situational language needs and a social forum for peer support, cultural information, comments and practice. The paper reports on interview data and social forum use. Our findings suggest that the MApp helps immigrants with their confidence; with relevant, practical language learning and practice of different language skills, and also supports social learning. Studying and practising language skills in the locations, and at times, of learner's choice, along with access to a social forum for socio-emotional support and feedback, it is a powerful combination of informal mobile language learning.

(2008). CompendiumLD – a tool for effective, efficient and creative learning design. Copyright and Moral Rights for the articles on this site are retained by the individual authors and/or other copyright owners. For more information on Open Research Online's data policy on reuse of materials please consult the policies page. Developers and teachers go through a complex decision making process when designing new learning activities – working towards an effective pedagogical mix, combining resources, tools, student and tutor support. This paper describes CompendiumLD, a prototype tool we have built to support practitioners through the process of designing learning activities. We describe how the tool fits into our vision of a dynamic, interactive set of resources and system tools to support effective, efficient and creative learning design. It describes CompendiumLD's features and explains the rationale behind their development. It shows how the tool is intended to aid designers make choices, and plan developments, facilitating creativity and efficiency in the design process. In our conclusions we consider how such a system can support the design of effective learning activities. Introduction The Open University (OU) is currently undertaking a Learning Design project, the aim of which is twofold: a) to capture and represent practice through user consultation and case studies and b) to support the course design process through the development of a tool and associated The project consists of a number of activities – including requirements gathering and evaluation to better understand the design process, assimilation of a suite of learning design tools and resources and technical development. The paper concentrates on the initial phase of technical development – namely the development of a visualisation tool for learning design. Learning design as a process is still not well understood and hence specification of tools to support it is difficult. With this in mind we felt it was more appropriate to work with and adapt an existing tool, linking tool development with interactive evaluation of its use by designers and teachers. As explained by Conole and Weller, an existing mindmapping, argumentation tool, Compendium, was chosen and adapted for some initial trials. Compendium " is a software tool providing a flexible visual interface for managing the connections between information and ideas " The initial trails consisted of 8-faculty based workshops with over 100 participants and two external workshops at other institutions. The initial evaluation was positive, users found the tool easy to use and …

It is important that the LAK community looks to the future, in order that it can help develop the policies, infrastructure and frameworks that will shape its future direction and activity. Taking as its basis the Visions of the Future study carried out by the Learning Analytics Community Exchange (LACE) project, the panelists will present future scenarios and their implications. The session will include time for the audience to discuss both the findings of the study and actions that could be taken by the LAK community in response to these findings.

The evidence shows that the use of learning analytics to improve and to innovate learning and teaching in Europe is still in its infancy. The high expectations have not yet been realised. Though early adopters are already taking a lead in research and development, the evidence on practice and successful implementation is still scarce. Furthermore, though the work across Europe on learning analytics is promising, it is currently fragmented. This underlines the need for a careful build-up of research and experimentation, with both practice and policies that have a unified European vision. Therefore, the study suggests that work is needed to make links between learning analytics, the beliefs and values that underpin this field, and European priority areas for education and training 2020. As a way of guiding the discussion about further development in this area, the Action List for Learning Analytics is proposed. The Action List for Learning Analytics focuses on seven areas of activity. It outlines a set of actions for educators, researchers, developers and policymakers in which learning analytics are used to drive work in Europe’s priority areas for education and training. Strategic work should take place to ensure that each area is covered, that there is no duplication of effort, that teams are working on all actions and that their work proceeds in parallel. Policy leadership and governance practices •Develop common visions of learning analytics that address strategic objectives and priorities •Develop a roadmap for learning analytics within Europe •Align learning analytics work with different sectors of education •Develop frameworks that enable the development of analytics •Assign responsibility for the development of learning analytics within Europe •Continuously work on reaching common understanding and developing new priorities Institutional leadership and governance practices •Create organisational structures to support the use of learning analytics and help educational leaders to implement these changes •Develop practices that are appropriate to different contexts •Develop and employ ethical standards, including data protection Collaboration and networking •Identify and build on work in related areas and other countries •Engage stakeholders throughout the process to create learning analytics that have useful features •Support collaboration with commercial organisations Teaching and learning practices •Develop learning analytics that makes good use of pedagogy •Align analytics with assessment practices Quality assessment and assurance practices •Develop a robust quality assurance process to ensure the validity and reliability of tools •Develop evaluation checklists for learning analytics tools Capacity building •Identify the skills required in different areas •Train and support researchers and developers to work in this field •Train and support educators to use analytics to support achievement Infrastructure •Develop technologies that enable development of analytics •Adapt and employ interoperability standards

Several decades of research in technology-enhanced learning (TEL) have clearly demonstrated the potential of digital technology to transform education. Yet the impact of TEL research on daily teaching-learning practices is still far from fulfilling this potential. Arguably, this is a gap in the capacity for learning design: educators need the tools and competencies which would allow them to identify educational challenges, describe the context in which they arise, identify the opportunities afforded by technology, project the insights derived from research, and devise new learning experiences. To address this gap, educators need tools and practices. Tools that would support them through the cycle of learning design – from conception to deployment and evaluation of techno-educational innovations. Professional practices that use such tools to ensure the robustness and effectiveness of their innovations and make learning design a daily habit and part of their professional identity. The METIS project (http://metis-project.org/) aims to contribute to this aim, by providing educators with an Integrated Learning Design Environment (ILDE) (Hernandez-Leo, Asensio-Perez, Derntl, Prieto, & Chacon, 2014; Hernandez-Leo et al., 2015) and a workshop package for training educators in using the ILDE to support effective learning design. Work Package 3, led by the OU (UK), is concerned with the design and development of the workshop package. This deliverable is the final version of the METIS workshop package. It includes • a meta-design for METIS workshops that provides a flexible reusable structure so that workshops can be customised to meet different needs , • a description of the rationale and pedagogical methodology on which the meta-design is based • guidance for instantiating the meta-design in different contexts and • example workshop packages based on the meta-design for three different educational sectors. This document provides educators with a basis for delivering workshops about using the ILDE to support effective learning design. To create and run a workshop suitable for your own context, please proceed in the following way. Firstly, consider the meta-design; then choose one of the example workshop packages closest to your context; finally, use the guidelines to adapt it for your needs.

CompendiumLD is a software tool for designing learning activities using a flexible visual interface. It has been developed as a tool to support lecturers, teachers and others involved in education to help them articulate their ideas and map out a design or learning sequence. This development has spanned 4 years, and the development process we have engaged in has served as a vehicle through which we have been able to better understand how educators relate to and use visual representations of learning designs.

Social inclusion of recent immigrants is a challenge in many countries for both immigrants and the host communities. To harness the potential of social, situated and opportunistic mobile interactions for the social inclusion of immigrants in a host country, we have developed an Incidental Learning Framework. This supports the design and evaluation of MApp, a suite of smartphone tools and services for recent immigrants. Developed within the European Union's MASELTOV project (http://www.maseltov.eu), the MApp delivers language learning activities, image-to-text translation, context-aware and interest-based recommendations, local information, game-based cultural learning and social support to immigrants in cities. Preliminary field trials in Vienna, Madrid and London have highlighted issues of mobile literacy, affordability, ethics and privacy challenges, as well as insights into motivations and possible measures of success. Incidental learning implemented on a smartphone app has implications for the relationship between formal and informal learning; new systems of learner support by other immigrants, mentors and volunteers; the design of learning materials that combine immediate assistance with longer term learner development; and potential conflicts between technological affordances, e.g. context awareness and learner tracking, and user preferences among vulnerable groups such as recent immigrants.