ISSN 1479-4403
Current Issue:
Vol. 2
Issue 2
December 2004

     


 

Electronic Journal of eLearning

     

 

Paper 1
     

Home Papers in Current Issue Previous Issues Site Map

      .

Home
About the Journal
Scope
Editorial Board
Submission Guidelines
Call for Papers

ECEL 2004: The 3rd European Conference on e-Learning
25-26 November 200
4

Click for information of ECEL 2003

 

A Government Crossing the Digital Divide to Promote ICT for Adult Learners
Karen Neville,
University College Cork, Ireland. Kneville@afis.ucc.ie


   

1.        Introduction

Appropriate training and education are important in today’s global market (Bocij et al, 1999). Many organisations make the mistake of not training their employees adequately in the utilization of ICT or in the use of internal information systems. This error in judgement is often due to the expense of providing training and the loss in productivity when employees are absent (McCormack, 1997). In some instances the wrong training is provided. Davis (1989) represents one of the original and most influential researchers in the area of user acceptance of technology and therefore ICT. He synthesises the findings of a range of diverse research streams to propose a number of constructs that are relevant to technology acceptance. These constructs fall into two broad categories, ease of use (EOU) and perceived usefulness (PU). Davis suggests a chain of causality between these categories: greater ease of use leads to higher perceived usefulness which in turn leads to more usage of technology. However different approaches can be applied to training (Dickson et al, 1997) and ‘on the job training’, is the most common approach. The reasoning for this approach is that, having obtained the job an employee can train while doing the job. Argyle (1994) argues that research shows that it is an ineffective approach to training as an employee could be doing the same job for years and not acquire appropriate social skills. The perception that something will come with experience is fraught with misconceptions (Maguire, 1986), as the learner could develop survival tactics rather than work related skills (Dickson et al, 1997). The second approach to training in organisations is ‘model the master training’. This approach follows a type of mentoring as the new employee is ‘shown the ropes’, by an experienced employee, for example postgraduate training programmes. However, Maguire et al., (1978) discovered limitations to the technique, ‘experts can have bad habits’. The final approach is referred to as directed training, which can be categorised as the ‘thinking’, ‘feeling’ and ‘doing’, methods of training (Philips and Fraser, 1982; Laird, 1991; Irving, 1995). Thinking involves a didactic approach as the learners, are required to assimilate the content rather than to think (Philips and Fraser, 1982). The feeling based approach involved group discussions. The doing approach involves action learning such as ‘role playing’. An effective training system must combine different approaches to obtain the goal of the corporate training strategy, which is a skilled workforce. Technology is used in training to support the needs of the employees. Web-based technology can be didactic, support problem-solving activities and provide a collaborative environment. Therefore, training can be delivered directly to the learners and the learners can collaborate with one another through online discussion forums. Training can be successfully handled online (Mason, 1990) to support a combined training model to incorporate both online and offline training. WBT allows “educators and students alike to perform learning related tasks”, (McCormack et al, 1997). The development of a training system requires careful investigation into the requirements of the problem situation (Checkland et al., 1990). The developer must consider factors such as the methods employed by employees to learn, incentives to ensure use, the identification of goals, objectives and the different roles that are needed to support this new approach to training (Driscoll, 1998). Models of factors that should be considered in the design of an instructional system are available (Rossi et al, 1993). For example, the developer must consider motivational factors, cognitive factors and instructional design principles prior to the development of the system.

2.        Theoretical foundation

In ‘lay terms', traditional training, is regarded as a training environment which encourages passive learning, does not develop problem-solving skills and ignores the individual needs of the learners, therefore it ignores the requirements of its End users. Traditional training has always incurred criticism, it is felt that despite huge advances in technology, the training room will always remain the same, that is, dysfunctional. It could be argued that advances in technology, such as multimedia and virtual simulations, have left the traditional classroom trailing behind with learners expecting more and more. The intensity of competition in the business market advances in technology, and a strong shift towards a knowledge-based economy have each contributed to the demand for virtual (electronic) learning environments. "There is no knowledge that is not power", and the organisation (public or private) that can utilise its knowledge resources more effectively than its competitor will persevere. An effective training support system can provide an organisation or a university with a strategic advantage in the market. Learning /training environments can help create and maintain skills and therefore the corporate knowledge base. They both alleviate the strain on corporate resources and facilitate students changing training needs. WBT systems can be described as learning delivery environments in which the WWW is its medium of delivery. The possibilities of which are limited only by constraints imposed by the organisation in question, such as technological or managerial support. Innovative companies and universities are using this implementation for a number of reasons, specifically to keep employees abreast of emerging technologies in their fields and to provide effective training to both staff and customers on new products and skills.

Designing a training system requires a thorough investigation into the use of the Web as a medium for delivery. The designer must be aware of the attributes of the WWW and the principles of instructional design to create a meaningful learning environment. The Web-based training is viewed, as already stated, as an innovative approach to teaching. It, like the traditional method, requires careful planning to be both effective and beneficial. As stated by McCormack et al (1997) a Web-based classroom must do more than just distribute information.... it should include resources such as discussion forums to support collaboration between learners and ultimately it should also support the needs of both the novice and advanced learner. A training environment is composed of a number of components that are integral to the effective operation of the environment, for example the development of content, the use of multimedia, Internet tools, hardware and software. A developer must understand the capabilities of these components (search engines, feedback pages and movie clips) as their use, will determine the success or the failure of the learning environment. Learning environments can help create and maintain skills and therefore the corporate knowledge base (Garvin, 1993). They both alleviate the strain on corporate resources and facilitate employees changing training needs (Driscoll, 1998).

This paper focuses on the design of a suitable training system to support mid-career employees and encourage collaboration among the employees and other organisations. The research outlines the factors necessary for the successful implementation and use of the system, through the investigation of current research and the analysis of the case environment. It also highlights the potential of the system to overcome the physical and pedagogical barriers of the traditional classroom. WBT environments can, when properly mediated and structured, facilitate co-operation (Entwistle, 1997), reduce conflict and avail of all of the benefits that technology can provide (Johnson and Johnson, 1990). The study concludes that training systems have the potential, when properly designed, to foster learning and collaboration.

3.        Research objective

The organisation chosen for this study was Golden Vale plc, a multinational food co-operative. The case study organisation involved in this research implemented a number of ICT training programmes in the past, all of which had failed to increase the use of ICT in the organisation. Preliminary research integrated the construction and implementation of an online system (Figure 3) with a training programme (Figure 2) for mid-career employees in Golden Vale. Davis (1989) identified two constructs as relevant to user acceptance of technology, namely ease of use (EOU) and perceived usefulness (PU). These constructs were operationalised into a set of principles to underpin the training programme, which was delivered in two phases, each specifically addressing one of Davis’ constructs. Additionally the study’s external monitor (the Irish Government) sought to remove any barriers to the acceptance of ICT and subsequently increase employee skills in the target case.

4.        Research approach

The overall research orientation was qualitative and reflexive in nature. A grounded theory perspective was adopted, and in line with this, an initial framework incorporating Davis’ (1989) constructs as preliminary ‘seed categories’ was created (see Figure 2). The novelty of this study was that the researchers went back to evaluate the ongoing success and value of the training system in Golden Vale. Thus, the research approach adopted for the study was based on a two-tier research design involving an in-depth investigation of the case study environment through an examination of the barriers to the use of ICT (which was primarily a fear of information technology (IT) and an evaluation of the training systems in terms of continued ICT usage.

5.        Case background

Since 1947, Golden Vale plc has been one of Ireland’s largest food co-operatives. The company is a vibrant force not only in the Irish dairy industry, but it is also one of the top cheese processors in Europe, employing 2,100 people in Ireland and over 300 in its foreign subsidiaries. Golden Vale Plc. is based in the eponymous ‘Golden Vale’, a region noted for the quality of the agricultural land and its produce. The company is sited in one of the largest towns in the region, with a population of 2,667. Golden Vale is by far and away the largest employer in the area. Thus, any slump in the long-term viability of Golden Vale would clearly have a catastrophic social and economic effect on the region. The majority of their employees are local residents, and while the younger employees would have a high standard of education, many of the mid-career employees (aged 35 years and over) would have joined Golden Vale in their teens, without even finishing their second-level education in many instances. These employees learned on the job, and have few, if any, educational or technical skills to equip them to work in other industry sectors. Given this, the Irish government, obviously mindful of a number of disastrous social catastrophes in other Irish towns, which had been dependent on a single large employer who failed to survive, funded a training initiative.

Four organisations (or consortia) were identified, by the Irish government as the core participants of this research, to monitor and evaluate the training initiative. The group provided valuable data regarding the needs of adult learners as well as participants for the target group. The IT and HR departments of Golden Vale were also key actors in the study as well as the group responsible for the creation of the training system, the ESRC (the Executive Systems Research Centre). The target group played a central role in the development of this research, as the group were at the center of the evaluation of the project. Key members of the consortia were and still are responsible for the coordination of the different activities in the training system. However the target or test group were both the end users and evaluators of the training system. The identification of the roles and responsibilities of each of the groups was vital to the success of the project and the acceptance of the training system devised as a result of the initiative. The training initiative was intended to provide a solid training in ICT for mid-career employees through technology itself. Thus, one of the primary objectives of the initiative was to provide a more skilled work group who would be able to find work more readily in other industry sectors should Golden Vale experience a catastrophe. Employees were also aware of the risk if they were to become unemployed and of the importance of ICT literacy in improving their career prospects within Golden Vale. The company had initiated several ICT training programmes, in the past, facilitated by their internal IT department who brought in training consultants to provide off-the-shelf training courses in standard ICT packages, such as word processing and spreadsheets. These training programmes, while having been applied in a textbook fashion, were acknowledged as having had little or no lasting effect in persuading employees to make ongoing use of technology in their work. The company decided to adopt a different approach for this initiative, and contacted the main university in the region to seek assistance. The author, with a number of colleagues, met with the IT and HR staff in the company and a name for the project was coined, M.E.E.T (Mid-career Employees Embracing Technology). The approach taken in previous training programmes in the company was discussed, and some of the participants were interviewed. It quickly became apparent that the employee base was not homogeneous in relation to their skills with ICT; thus, standard training programmes which tried to achieve an average common denominator would be inappropriate, in that those who were more advanced would find the material boring and lose interest, while those who didn’t understand the rudiments would be unable to engage with the material in the first place.

5.1         The target group

The target group was identified as a representation of the level of IT skills within the organisation. The data gathering techniques used, collected and examined information regarding the participant’s current level of computer skills, usage and future training requirements. The researchers deemed it appropriate to focus the research strategy on identifying the levels of computer proficiency and training requirements among the participants. The investigation strategy formulated to conduct the analysis stage of the research consisted of: interviewing a select number of the target group, group discussions and observation. The target group comprised of employees with varying roles within the organisation, senior management, administration, operators, supervisors and IT personnel. The group was interviewed to build a picture of the training system in operation and the system required. In total 16 interviews and 4 group discussions were conducted to ascertain the skills and the issues of the participants. The first objective of the data gathering techniques was to assess the participant’s level of computer proficiency and to group the participants accordingly. To ascertain this, each interviewee was required to rate their level of skills between 1 and 4, 1 representing a basic understanding of ICT and 4 an advanced level. The results enabled the researchers to determine the structure of the training system based on the different levels of skills. The information collected resulted in the following (see Table 1) breakdown of the target group’s level of computer proficiency:

Table 1: Levels of computer proficiency

Computer Proficiency Ratings

Computer Proficiency Rating No.
Basic understanding (1) 22
Good understanding (2) 17
Very good understanding (3) 4
Advanced understanding (4) 2
  Total 45

 

The level of computer usage among the participants was in direct proportion to their proficiency level. The participants with a basic understanding of computers reported limited usage in their job descriptions. A high proportion of those interviewed, 62%, reported no use of computers in work related activities and 38% reported some but limited interaction. Those respondents with a good understanding of computers reported a varying level of usage. However, the opinion among the different groups was varied regarding the availability of computer resources within the organisation. Level 1 reported a mixed view with equal numbers rating the access as good, average and poor. However those with a good and very good understanding also rated access as good but the majority of the groups with a level two and three rating are required to use computers to do their jobs. Some of the respondents did however remark that availability was good but finding the time to learn new things was difficult. The majority of the members of groups 2 and 3 did recognise the importance of increasing their ICT skills. It is also important to note that 50% of group three own a home PC. All of the participants recognised the need to develop skills in ICT. Each group attached the same benefits to the development of a new training system. The participants listed both personal and corporate benefits. The personal benefits ranged from an increased chance of promotion, increased efficiency, home accounts, accessing the Internet and the ability to teach their children the skills gained as a result of participating in the training program. Corporate benefits included increased communication, informed decision-making, greater communication and efficient record keeping. The participants from each of the groups provided detailed lists of their requirements for the new training system (see Figure 1). They suggested ways in which increased training and therefore computer usage would improve their job performance. The participants identified the importance of a structured training system that would increase their computer literacy, generate ideas for improved efficiency through incorporating IT into their work activities and help the participants solve problems when they arise. Participants also identified or requested training in fundamental applications such as Word, Excel and the Internet. Figure 1 presents the findings of the interviews conducted with the target group. Each level of participants as well as their managers, from prior experience with training initiatives, communicated a clear understanding of the factors needed for the system to be successful. Figure 1 also shows specifically the issues of each level. It therefore presents what they expect from the system. Each required customised training, small classes time to practice and a support system. However, due to the small number of employees level 3 and 4 were combined to form one level.

Figure 1: An analysis of the case environment

 

5.2         Training programme

5.2.1                    Phase one – Generic training

The researchers decided to address each of Davis’ two categories by adopting a two-phased training approach (see Figure 2). The first phase proposed was a generic training phase, during which the basic ICT concepts would be covered at a pace appropriate to each group, thus addressing the ease of use (EOU) construct. Following completion of this generic training, the second phase would involve applied training customised to address the everyday work tasks faced by the participants, thus addressing the perceived usefulness (PU) construct. The chronological ordering of these phases is congruent with Davis’ (1989) proposed chain of causality namely that greater ease of use would facilitate a higher perceived usefulness of ICT, thereby leading to greater usage. The items identified by Davis (1989) as being significantly correlated with ease of use include easy to learn controllable, clear and understandable, and easy to use.

Figure 2: Framework for operationalising the M.E.E.T programme

*The WBT system was developed to support both phases of the training programme. It enabled the employees to participate in the customisation (EOU) of the system and to add to the system through the discussion forum (PU). The arrows used in the diagram highlight the complexity of the inter-relationship between the two constructs (EOU/PU), suggesting that not only does EOU lead to PU but that PU increases the level of EOU.

This phase of the study is concerned with operationalising these in practice in a real situation. The following facets of the programme indicate how this ‘ease of use’ construct was operationalised:

§                An initial generic training phase was used to ensure that all participants achieved a reasonable level of literacy in ICT.

§                Participants were allocated to one of three groups based on their current level of ICT capability. This ensured that the common denominator for training in each group was uniform, thus reducing the possibility that participants might be too self-conscious to reveal their lack of understanding of training material.

§                All sessions were held in a very well equipped training laboratory, with state-of-the-art technology for the instructors and the participants.

§                The training laboratory was in a ‘neutral’ venue, a short distance away from the factory floor where the participants worked every day. This helped participants to focus on the training and avoid distractions.

§                The maximum duration of training sessions was restricted to two hours, thus ensuring that participants did not become overwhelmed with complex material, or bored with repetition of material already understood.

§                The number of participants at each training session was kept low—a maximum of six participants at each session. This was intended to ensure that all participants’ performance and progress could be monitored to ensure they understood the concepts.

§                Two instructors were in attendance at each session, thus achieving a trainee-instructor ratio of 3:1. One generally led the instruction, while the other had a roving role, visiting each workstation to ensure that all participants understood the material. When difficulties were encountered, the instructor would provide one-on-one instruction in a discreet manner until the difficulty was fully resolved.

§                All the instructors were selected following personal interviews by the company. Golden Vale is a rural location, and the participants had a rural background. The instructors selected had a rural background in the main. The company were of the opinion that one of the reasons previous training initiatives had failed to deliver was that instructors were perceived as dynamic ‘city-types’ who were more comfortable with Internet chat sessions over decaffeinated latte in cyber-cafes rather than in discussing hogget prices in a small tea-room. One can debate the rights and wrongs of such social stereotyping, but the rapport built up between the participants and the instructors was very impressive. At the end of the training, the participants visited the university to receive a Diploma, and the camaraderie between the participants and the instructors was very noticeable.

§                The training material was designed to be user-friendly. Different lessons were prepared for each element of the training. Exercises were chosen to reflect the participants’ work place. All participants received a copy of the instruction booklets.

§                The WBT system (see Figure 3) was also constructed to support and implement the training. The training material was available on-line, but in addition, a discussion forum was implemented. This enabled participants to provide feedback (anonymously, if desired) to the instructors. It also allowed them to pose queries, which other participants or the instructors could answer. All participants could see the initial queries and the discussion stream of answers from other participants and the instructors. This further extended the reach of the training as workers could log on to the system at home or at their work, during night-shift, for example, and pose questions for which answers would be available when they next logged on. The facility also allowed the employees to voice their satisfaction regarding the different elements of the training. This provided the participants with the opportunity to take part in the ongoing design of the hybrid training system, and therefore increase the likelihood of user acceptance (Whitten et al., 1994; Avison and Fitzgerald, 1995; Bocij et al., 1999).


 

Figure 3: The training system (both online & offline)

 

5.2.2        Evaluation of Phase one – Generic training

This section presents the findings gathered during an interim evaluation of the training system. A questionnaire was designed and posted to each of the 45 participants in the target group to determine their reaction to the training system devised to their specification. Feedback through the Web facility (Figure 3) was also requested and collected by the researchers to aid in the ongoing design of the prototype system. The information collected and analysed by the ESRC researchers are presented in Table 2. The objective of this interim evaluation was to determine the satisfaction ratings of the participants in the study. Prior training models or systems had failed to impact on either the employees or the organisation as a direct result of non-user participation. The obvious finding of this questionnaire as can be seen in Table 2 is that the satisfaction ratings were very high. The researchers could not detect any significant difference, statistically, between the groups of participants. The groups, as already described, were divided according to their current level of IT skills which were determined through interviews and observation to be novice, intermediate and advanced. The questionnaire was designed to determine the participant’s evaluation of the training received in the first phase of the training. Participants were required to scale their agreement or disagreement between 1 and 5. The maximum score on the construct is 1, indicating a strong agreement. Therefore the closer the rating is to 1 the stronger the agreement and a score of 5 would reflect the participant’s strongest disagreement. The instructors were also questioned regarding their evaluation of the lessons and therefore the training system designed to support their classes. The instructors were as optimistic as the participants regarding the predicted success of the project and the affect of the training system on the study. The instructors also reported an improvement in their own skills through delivering the classes and in utilising the training system to support their learners.

5.2.3        Phase two – Applied training

The items identified by Davis (1989) as reflecting the ‘perceived usefulness’ (PU) construct included, working more quickly, increased productivity, improved effectiveness and job performance, making the job easier, and again the obvious item, useful. These were operationalised in the study in the following way:

§                Again, as already mentioned, at a high level, the separation of the initial generic training phase from the subsequent applied training phase ensured that the usefulness of the technology could be demonstrated in the second training phase. Participants had achieved a base level of capability, and the researchers had made several visits to them in their work environment, inspecting work documents with a view to seeing how technology could be incorporated into their everyday work routines to solve problems.

Table 2: Summary of participant ratings for Phase 1 training

Phase One – Construct

Level

1

Level

 2

Level

 3

Avg.

Rating

Instructors were well prepared 1.3 1.5 1 1.3
Course notes were useful and interesting 1.8 1.5 1 1.4
I felt free to ask questions during the course 1.9 1.3 1 1.4
Instructors provided clear explanations 2 1.5 1 1.5
It helped me develop my computer/technology skills 1.9 1.7 1 1.5
Overall I was satisfied with the course 1.9 1.7 1 1.5
Instructors ensured that I understood course material 2.3 1.7 1 1.7
Interesting and stimulating assignments were provided 2.3 2.1 1 1.8
Course challenged me to think 2.2 1.8 1.7 1.9
It stimulated ideas about how to apply IT to my work 2.5 1.9 2 2.1
Overall Average 2 1.7 1.2 1.6

(1 = mostly agree - 5=mostly disagree)

§                Examples include the creation of templates to automate manual activities like creating time sheets and home accounts. Systems, already in existence, were also demonstrated to highlight the application of technology within the company. These exercises stimulated ideas in the application of the skills developed by the participants from the programme.

§                In addition to the examples suggested by the instructors, participants were encouraged to identify ways in which the technology could be employed in their work. Potential projects were explored during the training sessions in the applied training phase.

§                The participants were, like the general public worldwide, very interested in the Internet and World Wide Web, but felt their knowledge in the area was very limited. It was decided to leverage this to get participants to buy into the training process. Thus, the first introductory session for all groups of participants was a ‘web surfing’ session. This served to break the ice between instructors and participants in a friendly atmosphere. Participants were shown the rudimentary details and then began surfing the web themselves using various search engines, and visiting sites recommended by the instructors. This session was also used to demonstrate the WBT system (see Figure 3), which had been constructed specially to support the training. As already mentioned, it had been decided as a matter of policy that sessions would not exceed two hours. However, this introductory session stretched this limit most as participants were so enthusiastic and wanted to continue. The enthusiasm of the first wave of participants ensured that all later groups were very keen to get started on the training themselves. The participants were all very satisfied with their knowledge of the web and saw it as a very useful skill to have achieved.

§                Upon completion of the applied training phase, participants visited the university for a formal diploma presentation ceremony. The diploma parchments were accepted with pride, and many spoke of their satisfaction with their achievement, for many, the only educational certification they had ever received.

It was also intended that the training would be a dynamic and organic experience, capable of self-perpetuation. Thus, the advanced group were considered to have potential to play a considerable hands-on role in promoting the use of ICT throughout the company and in future training initiatives. This would be reflected in the job status of these individuals, thus, it would serve as a significant motivator.

5.2.4                    Evaluation of Phase two – Applied training

A postal survey was chosen to complement the personal interviews conducted in this stage of the study. The function of this survey, like the first, is to conduct an evaluation of both the second phase of the training and the WBT system used to support the MEET project. This survey addressed the following issues:

§                   - Determine the level of user satisfaction with the programme.

§                Establish the effectiveness of the WBT system in supporting training within the selected environment.

§                Establish whether the system was easy to use and therefore useful.

§                Identify limitations, if any, that hinder the participants use of the system.

A total of 26 responses were received out of 45 participants, giving an overall response of 57 percent. For various reasons three of the responses were found to be unusable, for example some participants did not answer the majority of the questions asked. When the researchers analysed the responses, it was determined that they could be grouped according to the participant’s level of computer proficiency. Each participant was asked to rate their current level between 1 and 5, 1 being novice and 5 being advanced. The responses collected were examined using basic statistical measures such as mean and medium. The researchers also presented various cross tabulations, to highlight the different groups responses to individual constructs as well as the overall average response to each question. Table 3 presents the findings of this postal survey; the main point to note is that the overall satisfaction with the hybrid training system was very high. As in the case of the first evaluation conducted the researchers could not find statistically significant differences between the groups or the different levels of participants. In terms of specific questions addressed, the construct with the highest rating of satisfaction is The Material was well presented which was encouraging, as the participants were very satisfied with the roles played by the instructors in both presenting the material and that of the roving role. The construct I was able to get help whenever I needed it was also high. One of the requirements determined during the analysis stage of the development was the creation of a support mechanism. This was facilitated through the WBT system, which provided 24-hour support to the participants. A high rating for the support obtained was very encouraging in determining the effectiveness of the system (see Figure 4). Constructs regarding the content of the site, The material was well presented, The course level was too high and Material was easily viewed on the screen, were also favourable regarding the effectiveness of the system. The training system was designed based on Davis’ model to be easy to use (see Figure 3). However it is difficult to determine if a system is both easy to use and useful. The satisfaction ratings received regarding the ease of use was encouraging as the participants found the site easy to navigate and therefore of use.

The researchers also identified limitations to the use of the system and therefore the skills developed through the programme. Lack of resources was identified during the first evaluation as the most significant complaint. However, during interviews, participants highlighted problems encountered in the use of the WBT system, which were as a direct result of the resources within the organisation. Lack of resources in the guise of inferior network connections was a serious problem. However the organisation is currently addressing the issue to facilitate their employee needs.

Another issue raised during the analysis stage of the study highlighted the need to provide time as well as resources for participants to practice the skills learned. The problem was identified prior to the commencement of the study but it is a slow process and the issue is still evident as some of the participants felt that they were still limited by lack of both time and resources. Finally, the training system, despite the limitations of the environment addressed the requirements of the participants in the study. It provided facilities for the users to review the lessons interactively. The discussion forum provided 24-hour support, so that the participants were in constant contact with both primarily the researchers and the other instructors. For the first time the participants themselves were given the opportunity to help design the training system, on an ongoing basis through the feedback facility available through the WBT system. The system was an effective method of supporting the training project in Golden Vale plc and enabling group collaboration and evaluation by all of the parties (consortia) involved through feedback mechanisms.

Table 3: Summary of participant ratings for Phase 2 training

WBT System Construct

(Golden Vale Plc.)

Level

1

Level

2

Level

3

Level

4

Avg.

Rating

The objectives were clearly explained 3.8 4 3.8 4 3.9
I received enough training on the site 3.2 3.5 2.8 4 3.4
The material was well presented 4.2 4 5 4 4.3
The course level was too high 2.8 1.5 3 2 2.3
The course level was too low 2.3 2.3 3 2 2.4
There was too much material to cover 2.4 2.8 2.6 2 2.5
The classes were too fast 3 3 2.4 2 2.6
The classes were too slow 2.2 2.5 2.5 2 2.3
I was able to get help whenever I needed it 4.2 3.5 4.6 4 4.1
The site complemented the training 3.6 2 3.6 3 3.1
The site was easy to use 3.6 3.5 4.2 3 3.6
The site was reliable 4.3 2.5 3 4 3.5
Material was easily viewed on screen 3.7 2.5 4 4 3.6
The system was accessed without problems 3.6 3 2.8 3