OER Benchmarking mood of Pick&Mix

Paul Bacsich: October 2011 Core criteria from Pick&Mix (distance learning version mood ) 16 active criteria Code Criterion name Criterion level 5 statement in Pick&Mix () All systems usable, with internal evidence to back this up. Regularly updated eLearning Strategy, integrated with Learning and Teaching Strategy and all related strategies (e.g. Distance Learning, if relevant). Effective decision-making for e-learning projects across the whole institution, including variations when justified. All staff trained in VLE use, appropriate to job type and retrained when needed. A fit for purpose costing system is used in all departments for costs of elearning. OER creation submood () OER usage submood () Susceptible to desk research (D) and/or survey (S)? S

04

Usability

All systems for creating OER, and created OER material, tested for usability. Regularly updated OER creation strategy, integrated with Learning and Teaching Strategy, IT strategy and all related substrategies (e.g. eLearning and Distance Learning). Effective decision-making for IT projects related to OER creation across the whole institution, including variations when justified. All staff trained in OER creation, appropriate to job type and retrained when needed. The costs issues associated with OER creation are well understood.

All systems used by students, and OER recommended for students, tested for usability.

06

e-Learning Strategy

Regularly updated OER D, S usage strategy, integrated with Learning and Teaching Strategy, IT strategy and all related substrategies (e.g. eLearning and Distance Learning).

07

Decisions on (IT) Projects

Effective decisionmaking for IT projects related to OER usage across the whole institution, including variations when justified.

10

Training

All staff trained in the D?, S issues (citation, plagiarism etc) raised by OER usage by students, appropriate to job type and retrained when needed. The potential costs issues (savings and additional costs) associated with OER usage are well understood. S

12

Costs

Bacsich

25 October 2011

BENCHMARKING FOR OER Pick&Mix version 0.90

Core criteria from Pick&Mix (distance learning version mood ) 16 active criteria Code Criterion name Criterion level 5 statement in Pick&Mix () Integrated annual planning process for e-learning integrated with overall course planning. All staff engaged in the e-learning process have nearby fastresponse technical support. There is effective decision-making for e-learning programmes across the whole institution, including variations when justified. OER creation submood () OER usage submood () Susceptible to desk research (D) and/or survey (S)? S

13

Planning Annually

Integrated annual planning process for OER creation, integrated with overall course planning. All staff engaged in the OER creation process have nearby fast-response technical support for the tools they need to use. There is effective decision-making for programmes creating OER across the whole institution, including variations when justified. The capability of leaders to make decisions regarding OER creation is fully developed at departmental and institutional level (not applicable)

Integrated annual planning process for OER usage, integrated with overall course planning.

16

Technical Support to Staff

(not applicable but see D?, S 92)

19

Decisions on Programmes

There is effective S decision-making for programmes making substantial planned use of OER across the whole institution, including variations when justified. The capability of S? leaders to make decisions regarding issues related to OER usage is fully developed at departmental and institutional level

22

Leadership in The capability of e-Learning leaders to make decisions regarding elearning is fully developed at departmental and institutional level. Management Style The overall institutional management style is appropriate to manage its mix of educational and business activities

29

(not applicable)

Bacsich

25 October 2011

BENCHMARKING FOR OER Pick&Mix version 0.90

Core criteria from Pick&Mix (distance learning version mood ) 16 active criteria Code Criterion name Criterion level 5 statement in Pick&Mix () The institution has effective processes designed to achieve high formal and informal credibility with relevant government and public agencies overseeing it. OER creation submood () OER usage submood () Susceptible to desk research (D) and/or survey (S)?

35

Relationship Management Upwards

The institution has effective processes designed to achieve high formal and informal credibility with relevant national and international agencies (COL, UNESCO, EU etc) fostering OER creation

The institution has S (of agencies?) effective processes designed to achieve high formal and informal credibility with relevant national and international agencies (COL, UNESCO, EU etc) fostering OER usage and with quality agencies who may raise issues (usability, accessibility etc) with OER usage The university IT D? systems searching for and delivering OER are as reliable as the main systems students and staff are used to from their wider experience as students and citizens.

53

Reliability

The e-learning (not applicable) system is as reliable as the main systems students and staff are used to from their wider experience as students and citizens. Market research done centrally and in or on behalf of all departments, and aware of elearning aspects; updated annually or prior to major programme planning. Market (and competitor) research done centrally and in or on behalf of all departments, and aware of the implications of OER creation aspects; updated annually or prior to major programme planning.

58

Market Research

Market research done S?? centrally and in or on behalf of all departments, and aware of OER usage aspects; updated annually or prior to major programme planning.

Bacsich

25 October 2011

BENCHMARKING FOR OER Pick&Mix version 0.90

Core criteria from Pick&Mix (distance learning version mood ) 16 active criteria Code Criterion name Criterion level 5 statement in Pick&Mix () A system where security breaches are known not to occur yet which allows staff and students to carry out their authorised duties easily and efficiently. OER creation submood () OER usage submood () Susceptible to desk research (D) and/or survey (S)? S?

60

Security

A system where (not applicable) security breaches allowing release of draft OER items are known not to occur yet which allows staff and students to carry out their authorised OER creation duties easily and efficiently. Students have good understanding of the rules governing use of OER (citation, plagiarism, etc) and always act on them.

91

Student Students have (not applicable) Understanding good of System understanding of the rules governing assignment submission, feedback, plagiarism, costs, attendance, etc and always act on them. Student Help Desk Help Desk is deemed as best practice. (not applicable)

92

There is a Help Desk D, S service which focuses on issues of student use of OER which is best practice. Frequent (ideally D annual) Student Satisfaction survey which has questions that explicitly addresses the main OER usage issues of relevance to students.

94

Student Satisfaction

Frequent (ideally annual) Student Satisfaction survey which explicitly addresses the main e-learning issues of relevance to students.

Frequent (ideally annual) Student Satisfaction survey which has questions that explicitly addresses the main OER creation issues of relevance to students.

Bacsich

25 October 2011

BENCHMARKING FOR OER Pick&Mix version 0.90

Additional criteria from Pick&Mix (mood ) 6 criteria Code Criterion name Criterion level 5 statement in Pick&Mix () All taken up elearning except some laggards. All e-learning material and services are accessible, and key components validated by external agencies. Conformance to external quality agency precepts and local guidelines for elearning within an overarching methodology. OER creation submood () OER usage submood () Susceptible to desk research (D) and/or survey (S)?

01

Adoption

All staff taken up OER creation except some laggards. All OER created are accessible, with key components validated by external agencies.

All staff taken up OER S usage (by students on their courses) except some laggards. All OER recommended S for use by students are accessible, with key components validated by external agencies.

05

Accessibility

17

Quality Assurance

All OER created is in conformance to external quality agency precepts and local guidelines for OER quality within an overarching methodology. All informally recognised experts in OER creation have been explicitly recognised in a financial way.

All OER recommended D?, S for use by students is in conformance to external quality agency precepts and local guidelines for OER quality within an overarching methodology (g OPAL).

18

Staff Recognition and Reward

All informally recognised elearning experts have been explicitly recognised in a financial way.

All informally D?, S recognised experts in using OER in their courses have been explicitly recognised in a financial way. All students have D?, S electronic resources with the maximum feasible amount of OER appropriately embedded within their curriculum. All students have OER D?, S information literacy specifically search for, use and citation of OER appropriately embedded within their curriculum.
25 October 2011

75

Library Services eResources

All students have (not applicable) electronic resources appropriately embedded within their curriculum. All students have (not applicable) information literacy appropriately embedded within their curriculum.

76

Information Literacy of Students

Bacsich