Wednesday, 8 February 2012

Modernising assessment

I came across an interesting paper recently relating to the assessment of Web 2.0 (social media) in universities. The paper is entitled Worth it? Findings from a study of how academics assess students' Web 2.0 activities and was published in the February 2012 edition of Research in Learning Technology. The full paper can be downloaded here.

The paper points out that the use of social media for assessment was limited. When it was used, it was used for low- or mid-stakes assessment. The most common technologies were blogs and wikis. And the subjects that used it most were Social Science, IT, and Education. Its conclusion was not good:

"Web 2.0 cannot be seen to be transforming assessment. On the contrary, its affordances are being appropriated to perpetuate conventional, invisible assessment practices."

The use of Web 2.0 in assessment is a professional interest of mine. My paper on modernising assessment was referenced in this research.

I suspect that practice in FE in the UK is no better and, possibly, worse. One of the goals of the HN Review is to improve assessment. I plan to look at ways that we could utilise some of the affordances of social media to do this. Look out for more information on an "HN 2.0" project in the near future.

Tuesday, 10 January 2012

What you can do now

We hope to have the updated HNC award available to centres from April. But that doesn't mean that you have to wait until then to start preparing to deliver the updated award.

The draft framework was broadly accepted by the Validation Panel, so the shape of the award is known. In fact, none of the conditions relate to the mandatory section of the qualification, which will be unchanged. The only structural change will be the addition of one or two units to the optional section.

We are presently validating the new or revised units in the award. In fact, some of the units have been validated and are now "feature complete". We'll share these units with you in the near future. Watch this space.

You will start to see final (coded) versions of the units appear on the SQA website from February and definitive Arrangements will be published on the SQA in April. There will be a launch event in June.

The existing HNC framework will continue to be "current" until 31 August 2014 (the date of the final certification) so there is no requirement for you to offer the new award right now, but we think that it is so much better than the existing award that we hope you consider offering the new version from August of this year.

Contact Caroline if you want to know more about this development.

Wednesday, 21 December 2011

Dealing with the validation conditions

The validation event was very thorough, and resulted in several conditions and recommendations. I created an action plan to deal with them, and allocate each condition or recommendation to a specific member of the QDT. For example, the Validation Panel wanted formal written support from the Sector Skills Council (E-Skills), which I am working on. Janice Maxted, the Qualification Leader for the HNC, is revising the Graded Unit in line with the Panel's suggestions. There are several other actions being worked on by various people.

Caroline, Hilary and myself are also busy validating the 52 new or revised units in the new HNC/HNDs awards. We are slowly working through these and hope to have all of the units validated by the end of January.

Although there is plenty to do, we hope to have all of the conditions lifted by the end of January, so that the HNC award is available to centres from April.

Contact Caroline if you want to know more about how we're progressing with the validation of the HNC award.

Wednesday, 14 December 2011

E-assessment support for the new awards

I met with Graeme Clark, of the E-Assessment & Learning team in SQA, this afternoon to discuss how that team could support the new HN awards.

The existing HNC/D Computing is the best supported HN award on SOLAR, SQA's e-testing system, with over 70 units currently supported by some form of online testing.

The purpose of the meeting was the discuss the extent of change in the new awards, and how much, if any, of the existing assessments could be repurposed for the new qualifications. Caroline and I emphasised that the new awards were significantly different from the existing qualifications and that a significant amount of new material will be needed to support them. Graeme was very supportive, and went away to consider how best SOLAR could be used to help centres to assess the new HN awards.

The revised HNC Computing will be available to centres from April 2012. The existing award will end (last registration) in 2014.

Contact Graeme if you want to know more about SOLAR.

Monday, 12 December 2011

Validation event

The validation event for the HNC Computing award was held on Friday in the SQA offices in Glasgow.

The validation panel was chaired by Cameron Walker, of Aberdeen College, and members included representatives on FE and employers. A key selection criterion for members of the Panel is that they have had no previous involvement in the development, so that they can bring a fresh perspective to the proposals.

The QDT was represented by Gerry Mackie, the Lead Developer, and a couple of members of the QDT, including the Qualification Leader for the HNC (Janice Maxted of Langside College).


The Validation Panel scrutinised the proposals very thoroughly, but were constructive throughout the event. It was a long day, commencing at 10am and concluding at 4pm, but, at the end of the day, I felt the Panel's ideas will make real improvements to the award.

The outcome of the validation was that the award was validated with a number of conditions. These mostly related to the quality of the documentation rather than the quality of the proposals. In fact, it was particularly pleasing that the Panel liked the structure of the new award, which will not change from the original draft framework. But it will be better explained and better exemplified (for example, we will add suggested pathways through the award).

Organising, preparing for, and conducting validation events is hard, and somethimes stressful, work. But events like Friday's reminded me of the benefits that they can bring. Without doubt the qualification will be improved as a result.

We agreed to revise the proposals by the end of January so we hope to have the conditions lifted in February, when we can focus on the HNDs. The new HNC Computing will be available to centres from April 2012.

Contact Caroline if you want to know more about any of the awards in this development or find out more about how SQA validates its qualifications.

Monday, 21 November 2011

Progress update


This seems a good time to provide an update on progress.

We've been making steady progress with the awards. The frameworks have been agreed for some time, and we've spent most of the last three months writing units. This is coming along OK but, as always, it takes time to finalise such a large number of new and revised units. But most of the units are now at the validation stage, which is what me and the team are working on. The contents of the units are left to subject specialists, and the actual validation of each unit is more of a desk-check that the unit is presented correctly and uses appropriate language. Me, Caroline and Hilary are carrying out those checks now. SQA also carries out a peer review of new units, whereby another member of staff samples the units after we've validated them. There is no foolproof method of writing units, but these units have certainly been scrutinised by many people (on some occasions, as many as six people) before they will be published.

The validation event takes place on Friday, 9 December. The Lead Developer, Gerry Mackie, is busy putting together a validation proposal document (VPD) that is used at the event as the basis of discussions. Caroline has assembled a good validation panel, which consists of educationalists, employers and an SQA representative. We hope to send the VPD to the Panel members on Monday of next week to give them plenty of time to consider our proposals.

Individual units are validated separately from the group award, which is carried out at the aforementioned validation event, but the exception to that rule is the Graded Unit, which is also validated at the validation event. Janice Maxted, the Qualification Leader for the HNC award, is busy working on that unit at this time.

Contact Caroline if you want to know more about this development.

Friday, 18 November 2011

HNC Computing - Validation Event

The validation event for the HNC Computing award will take place on Friday 9th December 2011 in SQA offices, Glasgow.

We have an excellent panel on board which are well represented by FE, HE and Industry.  All members of the panel have had no involvement in the development process but have particular interest in the award from a delivery, articulation and employment perspective.

The remaining four HND Computing awards will go forward for validation in March 2012 and will be available for centres to deliver from August 2012.

We are currently in the process of validating the 52 units that have came out of the HNC/D developments and these will start to appear on the SQA website over the next couple of months.

Thursday, 3 November 2011

Unit finalisation and validation meeting

I met with Gerry (Lead Developer), Caroline and Hilary this morning to discuss how we would finalise and validate the units. Units are validated separately from the group award.

This development is going to produce a large number of new and revised units. Fifty four in total. So, it's a big job to finalise the draft versions and put them through validation.

Each unit has been scrutinised by several people -- the writer, of course, but also a vetter and, usually, an External Verifier. The Qualification Leader for each award has also looked at the units in his/her award and, of course, the Lead Developer has oversight of all of the awards. So, I'm pretty confident, at the end of this process, the contents of the units (from a subject perspective) will be right.

As usual at this stage in the development the progress is mixed. We aimed to have all of the units completed by the end of October. Many units were submitted on time, but there are a number not yet complete. In these circumstances we offer the writer extra time and support, or assign a new writer to the unit.

Me, Caroline and Hilary now have to ensure that the units are OK from a technical perspective. By that I mean that the units are written correctly and reach an acceptable standard. We will do this during November. Our priority is the units in the HNC, since we are validating that award first. This month is going to be busy for us.

Contact Caroline if you want to know more about the new units in any of these awards.

Friday, 21 October 2011

QDT meeting

The final meeting of the QDT (prior to the HNC validation) took place this morning. The main reason for having the meeting was to bring everyone up-to-date with progress.

Unsurprisingly, the turn-out was not great, given that it is the October holiday for many people, but eight people made it along.



We discussed the frameworks, links with vendors, BCS accreditation and the forthcoming validation event.

The vendor item was particularly interesting. We recently devised a procedure for adding vendor qualifications to the new frameworks and today, for the first time, the QDT had an opportunity to consider some applications from vendors. We looked at three -- from Microsoft, COMPTIA, and CIW. We are piloting a system of direct accreditation of vendor awards inside HNs, so it was interesting to "test" the process. Some of the vendor applications were approved, and it was good to see the "vendor box" in the new frameworks begin to get filled.

The development is on schedule. I'm hoping to receive most of the new and revised units at the end of this month, and the units will be validated during November. The group award validation event will take place in early December. We hope to have the new HNC award available to centres from March 2012.

The next QDT meeting will take place early next year, once the HNC validation event has taken place and we can focus on the HND awards.

Thursday, 13 October 2011

Progress meetings

Every couple of weeks, me and Caroline meet with the lead developer (Gerry Mackie) to discuss progress. We had one of our progress meetings yesterday morning. At these meetings, we go through our progress plan line by line, to ensure that we are moving forward.

At yesterday's meeting we discussed membership of the validation panel. The validation panel must be completely independent of the QDT, since a key role for the panel is to scrutinise the proposals, so we went through some of the volunteers who had asked to serve on the panel (my recent update letter asked for volunteers). We think we came up with a pretty good mix of people. We also discussed who should serve on the QDT at the validation event. Again, we came up with a team who we think will do a good job. Caroline is currently contacting all of the individuals to check their availability.

The main task right now is unit writing. A team of people are currently busy creating new and revised units. The deadline for the units is the end of this month, so this is a very busy period for the team. Gerry is writing the validation proposal document (VPD), which is coming along nicely.

Contact Gerry if you want to know more about progress, or contact Caroline if you want to know more about the validation process.