• No results found

5 ANALYSIS AND RESULTS

5.3 SCALE STRUCTURE AND RELIABILITY

All the scales used in this study were assessed for internal consistency and for dimensionality. Accordingly, internal consistency among the items of each scale was tested using the Cronbach’s alpha procedure (Cronbach, 1951), and to analyse the underlying dimensionality, the Principle Component Analysis was used. The procedure also determined which items to integrate into the corresponding composite measures of the respective scales.

132 5.3.1 Scale Structures

Scales structures were determined by employing Principal Component Analysis with Varimax rotation. A minimum loading criterion of 1 was adopted to recognise a factor, while 0.5 was considered the minimum loading criterion of the items on a given factor.

Any item with a value greater than this load criterion for more than one factor in a scale was deemed to be cross-loaded. Furthermore, any communality value below 0.6 was considered inadequate. In order to confirm the adequacy of the sample size for factor analysis, Kaiser-Meyer-Olkin (KMO) Measure of Sampling Adequacy tests were also carried out. The KMO values with regards to each scale were well above the required threshold of 0.50 (Kaiser & Rice, 1974) indicating the adequacy of the sample size for the respective scale. A summary of the Principal Component Analysis after removing certain items from some scales is presented in Table 5-2 and each variable is described in the following sections.

Table 5-2 – Results of the Principal Component Analysis

Scale

Perceived Music Message Congruence 0.83 3.36 84.62

Perceived Message Complexity 0.79 2.26 75.36

Dependent Variables

Psychological Discomfort 0.75 2.54 84.59

Cognitive Load 0.79 2.27 75.53

Attitude towards Advertisement 0.85 3.42 85.46

Covariate

Need for Cognition 0.88 3.68 73.62

5.3.1.1 Independent Measures

The five items in Perceived Message Complexity were analysed, and as anticipated, the scale was unidimensional. However, two items (DF4 and DF5) were removed from the scale due to low communality scores. The total variance explained by this factor without the above two items was 75.4%. Similarly, four items used in the perceived Music Message Congruence scale were also unidimensional, explaining 84.6%

133

variance. The results did not show any prominent issues with communality values.

Thus, all the items of this scale were retained for further analysis.

5.3.1.2 Process Variables

There were two variables considered under process variables -Psychological Discomfort and Cognitive Load. The Psychological Discomfort scale, consisting of three items, produced a single factor explaining a total variance of 84.6%. Similarly, Cognitive Load scale, consisting of five items, produced a single factor explaining 61.5% of total variance. However, two items (CL4 and CL5) were associated with low communality values and therefore deleted from the scale. The new three item scale explained 75.5% of the total variance.

5.3.1.3 Output Variables

Out of the five output variables mentioned in the conceptual model, only the Attitude towards Advertisement was measured through a semantic-differential scale. The other four memory-related variables were measured using special procedures explained in Section 4.3.3 of Chapter 4. Hence, only Attitude towards Advertisement was considered in this analysis and it produced a single factor explaining 85.5% of the total variance. There was no apparent issue associated with items in the scale and therefore all the items were retained.

5.3.1.4 Covariates

Out of the two covariates, only Need for Cognition was measured with a scale. A different method was employed to calculate the Working Memory Capacity, which is described in Section 4.3.4.2 of Chapter 4.

The modified scale used for measuring Need for Cognition consisted of five items. The initial analysis carried out on these items revealed that the scale was unidimensional with a factor explaining 73.6% of the total variance. As expected, no item appeared to be problematic and hence all items were retained in for further analysis.

134 5.3.2 Scale Reliability

Following the factor analysis, all the scales were analysed for their internal consistency with the use of Cronbach’s alpha procedure. The summary of final reliability scores are listed in Table 5-3.

Table 5-3 - Reliability Scores of the Scales Used

Scale Cronbach’s

Alpha Independent Variables

Perceived Music Congruence 0.96

Perceived Message Complexity 0.84

Dependent Variables

Psychological Discomfort 0.91

Cognitive Load 0.84

Attitude Towards Advertisement 0.97

Covariates

Need for Cognition 0.91

All the scales demonstrated an acceptable level of alpha values well above 0.70.

However, certain items in some scales were deleted in the previous analysis for further improvement, except for the Perceived Music Message Congruence and Attitude scales.

Despite the existing alpha values of these two scales being well within the acceptable range, the analysis indicated that the removal of FT4 from the Congruence scale and ATT2 from the Attitude scale would further increase reliability. Hence, the items were omitted from the respective scales for further analysis.

5.3.2.1 Inter-coding Reliability

Immediate and delayed recall measures were obtained through a set of open-ended questions. Since the responses were not listed for the participants to choose from, the score had to be obtained by marking the answers manually. Therefore, obtaining impartial as well as consistent results was important. In achieving this objective, the written answer-scripts were marked by two independent markers who were unaware of the actual research objectives, and the inter-coding consistency was checked with the correlation coefficients of marks in each category.

135

Table 5-4 - Inter-Coding Consistency of Recall Tests

Category or Recall Correlation Coefficient

Sig

Immediate

Category Recall 0.95 .00

Brand Recall 0.97 .00

Simple Message Recall 0.95 .00

Complex Message Recall 0.93 .00

Delayed

Category Recall 0.98 .00

Brand Recall 0.99 .00

Simple Message Recall 0.95 .00

Complex Message Recall 0.99 .00

Accordingly, it appeared that there were very high correlations between the marks of two markers across all four categories (see Table 5-4). Therefore, the marks under each category were averaged into a single mark and used for further analysis.