|
|
|||||||||||||||||||||||||||||||||||||||
|
Faiola, A., and Matei, S. A. (2005). Cultural cognitive style and web design: Beyond a behavioral inquiry into computer-mediated communication. Journal of Computer-Mediated Communication, 11(1), article 18. http://jcmc.indiana.edu/vol11/issue1/faiola.html
|
|||||||||||||||||||||||||||||||||||||||
|
Cultural Cognitive Style and Web Design:
Beyond a Behavioral Inquiry into Computer-Mediated Communication Numerous studies have identified links among culture, user preferences, and web site usability. Most of these studies were reports of findings from a behavioral perspective in explaining how cultural factors affect processes of web-related content design and use. Based on the research of Vygotsky and Nisbett, the authors propose a broader model, referred to as "cultural cognition theory," by which web design, like other types of information production, is seen as being shaped by cultural cognitive processes that impact the designers' cognitive style. This study explores issues related to web designers' cultural cognitive styles and their impact on user responses. The results of an on-line experiment that exposed American1 and Chinese users to sites created by both Chinese and American designers indicate that users perform information-seeking tasks faster when using web content created by designers from their own cultures.
Since the creation of the World Wide Web Consortium (W3C) in 1994,
much attention has been directed at the design and usability of
communication technologies. The W3C's long term goals for the web
have taken into consideration not only the engineering of new online
technologies, but also the ways in which the development of
environments might better serve a world community as a forum for the
communication and dissemination of information (Vincent & Camp,
2005).
A Merging of Research Perspectives
For more than a decade, the subject of cross-cultural online
communication and web usability has been gaining prominence among
multimedia, hypermedia, and communication technology researchers
(Bourges-Waldegg & Scrivener, 1998; Burnett & Buerkle, 2004;
Choong, & Salvendy, 1999; Del Gado & Nielsen, 1996; Danet
& Herring, 2003; Ess & Sudweeks, 1998, 2001; Eveland &
Dunwoody, 2000; Herring, 1996; Kim & Allen, 2002; Matei &
Ball-Rokeach, 2001; Nielsen, 1990; Preece, 2001; Sears, Jacko, &
Dubach, 2000; Wheeler, 1998). Numerous cross-cultural communication
(CCC) studies have made links between culture and web usability
(Chau, Cole, Massey, Montoya-Weiss, & O'Keefe, 2002; Faiola,
2002, 2004; Trompenaars, 1997). These include studies that address
cross-cultural web design and usability with specific concern for
user preferences from a behavioral perspective (Barber & Badre,
1998; Honold, 2000; Larson & Czerwinski, 1998; Liu, Lin, &
Wang, 2003; Marcus, 2000; Marcus & Gould, 2000; Tractinsky,
1997; Zahedi, van Pelt, & Song, 2001).
Behavior versus Cognitive Perspectives
At the outset it is important to be clear about the difference in
research methodologies between behavioral and cognitive psychology,
and the apparent paradox of how the findings of cognitive research
are also based on observable behavior. How can researchers be
assured that their findings truly reflect cognitive processes,
rather than behavioral responses?
From Hall and Hofstede to Vygotsky and Nisbett
The dramatic shift in psychology from behavioralism to cognitive
psychology over the past half century marked a simultaneous shift
toward viewing both cognition and behavior from within an
individuals' cultural context. Greene (1995) holds that human action
is influenced by three key domains that function as causal factors
in the production of action: socio-cultural, physiological, and
psychological. A cultural perspective on cognition assumes that
humans are not only prepared biologically with a variety of
physiological and psychological components but also with socially
shaped propensities. Hence, the human psychological profile is
formed through biological, social, and cultural processes. This
profile includes particular ways of adaptation and adjustment to
one's socio-cultural environment. The socio-cultural shaping of
cognition may transpire in the production of action in particular
ways in each culture. An assortment of interpersonal and social
factors in various cultures may be significant predictors of
cognition.
Cultural Psychology as the Theoretical Underpinning of Cultural Cognition
A powerful cognitive perspective on culture and behavior was
proposed by Richard Nisbett (Nisbett & Norenzayan, 2002;
Nisbett, Peng, Choi, & Norenzayan, 2001). His theoretical
grounding, in significant measure inspired by Vygotsky's early work
(1934/1979, 1932/1989) in cultural psychology, is that individual
psychology is a cultural product. Nisbett's "cultural
psychology" can be defined as an examination of the ways in
which cultural traditions and social practices create differences in
how people think and feel. These differences in subjectivity and
introspection are due to context and the constant dynamics of
cultural environments (Shweder, 1990). Nisbett starts from
Vygotsky's (1934/1979) idea that cognitive processes emerge from
practical activity that is culturally constrained and historically
developed. Vygotsky and others of the Russian School spent over a
decade elaborating a psychology of higher mental processes by
designing an empiricist framework for study. Vygotsky's research was
further developed by Soviet psychologist A. R. Luria (1976) in the
1960s-1970s, and continues to be a basis for reflection, analysis,
and empirical inquiry for many international scholars in cultural
and psychological anthropology.
Cognitive style, as defined by Riding and Rayner (1998), is an
individual's preferred approach to organizing and representing
information or, according to Ford, Wood, and Walsh (1994), a
collection of strategies that individuals differ by when processing
information (p. 79). Goldstein and Blackman (1978) further nuance
this view, adding that cognitive styles are the characteristic ways
in which people: 1) "conceptually organize their
environment," and 2) spontaneously filter and process stimuli
so that their environment assumes psychological meaning. Farnen
(1993) suggested that this process provides a "mediating
function for information transformation" (p. 378).
The present study explores the relationship between variations in the cultural cognitive style of web designers as reflected in their web design, and user performance. The overarching research goal is to answer a simple yet fundamental question: Does the cultural cognitive style of web designers, as reflected in the web content they design, help users who share the same cultural background as the designer to perform information-related tasks faster? Formally, the hypothesis we advance is: H1: Online task time performance of users will be faster when using web sites created by designers from their own national culture. One implication is that web sites created by designers from cultures other than those of the users would cause those users more difficulty in finding information, reading text, and navigating, and would therefore produce an overall sense of uneasiness with the usability and aesthetic aspects of the site. Relevant to the results of this study is the assumption that difficulties experienced by the users would not be assigned to the potentially low quality of the site's design, but rather would be ascribed to the cultural cognitive style employed by the designer. Users
Our study compares the performance of Chinese and American users
while interacting with sites created by American designers from
Indiana University Purdue University Indianapolis (IUPUI) and
Chinese designers from mainland China in the first year of graduate
school at Purdue University. The two cultures were selected because
of their importance in the global communication and cultural
landscape and the fundamental cultural-cognitive styles that
distinguish them. Selecting a comparable sample of Chinese and
American web users was not easy, however. Since the inception of
their discipline, cross-cultural researchers have found it difficult
to acquire random or stratified samples. This is especially true if
users are living in multiple cities and countries around the world
and if the medium chosen for study is the Internet. Our study also
had to deal with governmental restrictions for accessing external
web sites in China. As a result, we decided to select a sample of
American and Chinese students from a number of American
universities. The students were contacted via email, using a
convenience sampling technique for the American sample, and a more
rigorous methodology for the Chinese students. Email lists for
Chinese student associations (clubs) at 31 different American
university web sites and personal invitations forwarded by three
Chinese professors teaching in the U.S. to their Chinese student
contacts were used for inviting students to participate in the
study. The American students were recruited from the IUPUI student
population in the School of Informatics. One hundred and fifty
invitation letters were handed out in three separate classes. The
invitation letters contained the same recruiting information that
was sent to the Chinese students through email, as outlined above.
Table 1. Online test invitation letter
results
Treatment
The treatment in this study was interaction with two web sites: one
designed by an American and the other by a Chinese designer. The two
sites were translated into English or Chinese and each culture group
was split into two groups, such that half of the Chinese students
were exposed to the American-designed site and half to the
Chinese-designed site, both of which were written in Chinese, while
half of the American users were exposed to the Chinese-designed site
and half to the American-designed site, both of which were written
in English. For both conditions (exposure to American/Chinese sites)
and for both ethnic groups, the subjects did not know the national
origin of the web designer, and the content of the sites did not
betray in any way the nationality of the designer.
Treatment Strength Treatment strength refers to the number of web sites delivered to each user. When users came to the online test site, they were only exposed to one of the two sites. The two web sites were delivered by rotation, depending on the order in which users visited the site (see Figure 2 below). Users were only exposed to one site because of possible multiple-treatment interference, or what we refer to as "accumulated learner advantage." In this major threat to validity, if subjects were to see multiple sites of the same content, their performance level might improve because of learner knowledge gained from the first site experience.
Figure 1. The home pages of the two test sites:
The left web site was created by American web designers, and the right
web site was created by Chinese web designers
Dependent variable
The dependent variable was the time required to respond to six
online questions (also referred to as tasks) that asked the users to
provide answers after interacting with the test web site. The users
were instructed to read the questions that were located in a
separate frame (panel) at the bottom of the interface. After a user
searched throughout the site, he/she answered appropriately by
clicking the "yes" or "no" button, and then
clicked the "Next" button to precede to the next question
(see Figure 3). At this point, the system recorded that the user had
finished the task and the time was recorded. As such, the primary
use of the "yes" or "no" function was to give a
time-stamp to the system for time-on-task recording in the case of
each user.
Figure 2. Research portal homepage for the
test site. Figure shows the rotation sequence in which each of the
language-specific sites were delivered to the users as they visited the
site. CA=Chinese site designed by an American; CC=Chinese site designed
by a Chinese.
Figure 3. One of the American test
web site tasks with the question panel at the bottom, as well as the
"yes" or "no" option buttons, with the
"Next" button to proceed
Data collection Data were collected by means of an automated tracking system on the local server located in the Indiana University Purdue University Indianapolis (IUPUI) School of Informatics. Recorded data tracked users anonymously, giving each visitor to the test site a tracking number and a date and time stamp for the execution of each task, as well as the post-task questionnaire.
We analyzed the data using an ANOVA 2x2 design with the user's cultural
background as the independent variable, interaction with Chinese vs.
American designed web sites as conditions, and task performance times
for the six tasks as dependent variables. The results indicated that
only the first four tasks provided significant interaction effects,
supporting the hypothesis that the cultural cognitive style of web
designers (reflected in the web content designed) would facilitate the
task performance of users who share the same cultural background with
the designer.
Figure 4. Performance times of users for Tasks
1-4 when using sites created by designers of their own versus the other
national culture
The two-way ANOVAs for tasks 5 and 6 did not provide support for our hypothesis. No significant interaction effects were found for either task 5 (F(1, 49)=.009, p=.923) or task 6 (F(1, 49)=.038, p=.847). Also, despite the fact that in both cases all respondents seemed to perform better when interacting with the Chinese sites, there was no main effect for web site cultural background (see Figure 4).
Figure 5. No significant performance times
for Tasks 5 and 6 of both cultures
Figure 6. Performance times for Task 1 and 2
of both cultures
Figure 7. Performance times for Task 3 and 4
of both cultures
Pivotal to the theoretical underpinning of this study is the work of
Nisbett in cultural cognition theory (Nisbett & Norenzayan,
2002; Nisbett, et al., 2001), which we have extended and applied to
studying the cognitive style of web site designers (Chen &
Macredie, 2002; Ford, et al., 1994). These theories suggested a
novel approach in CMC research: observing the performance effects of
web sites that are influenced at the design level by different
cultural cognitive styles.
Table 2. Users exiting the test after
task four
In addition, it should be noted that tasks 5 and 6 were more complex than the first four. They required a more rigorous search for answers by navigating throughout the web site, which demanded more cognitive effort and problem-solving. This might also have contributed to subject attrition and a more negligent approach to answering the questions. Conclusion: Looking to the Future
The results of this study substantiate that cognitive differences at
the design level exist in the form of cultural styles that are
perceptible to users. Although the purpose of this study was not to
provide web design recommendations per se, the results strongly
suggest that awareness of cultural cognitive style is necessary for
the improvement of online communication. Building upon this
research, we foresee future work that will better inform web site
designers about how to respond to implicit thinking patterns of
cross-cultural users. We intend to improve and extend this research
agenda through a larger sample study in the future.
Adams, R. J., & Khoo, S. T. (1996). Quest: The Interactive Test Analysis System. Melbourne, Australia: Australian Council for Educational Research. Barber, W., & Badre, A. (1998). Culturability: The Merging of Culture and Usability. Retrieved January 10, 2003 from http://research.microsoft.com/users/marycz/hfweb98/barber/index.htm Bond, T. G., & Fox, C. M. (2001). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Mahwah, NJ: Lawrence Erlbaum Associates. Bourges-Waldegg, P., & Scrivener, A. R. (1998). Meaning: The central issue in cross-cultural HCI design. Interacting with Computers Special Issue, 9 (3), 287-309. Burnett, G., & Buerkle, H. (2004). Information exchange in virtual communities: A comparative study. Journal of Computer-Mediated Communication, 9 (2). Retrieved October 1, 2005 from http://jcmc.indiana.edu/vol9/issue2/burnett.html Cahan, E. D., & White, S. H. (1992). Proposals for a second psychology. American Psychologist, 47, 224-235. Chau, P. Y. K., Cole, M., Massey, A. P., Montoya-Weiss, M., & O'Keefe, R. M. (2002). Cultural differences in the online behavior of consumers. Communications of the ACM, 45 (10), 138-143. Chen, S. Y., & Ford, N.J. (1998). Modelling user navigation behaviours in a hypermedia-based learning system: An individual differences approach. International Journal of Knowledge Organization, 25 (3), 67–78. Chen, S. Y., & Macredie, R. D. (2002). Cognitive styles and hypermedia navigation: Development of a learning model. Journal of the American Society for Information Science and Technology, 53 (1), 3-15. Choong, Y. Y., & Salvendy, G. (1999). Implications for design of computer interfaces for Chinese users in mainland China. International Journal of Human–Computer Interaction, 11 (1), 29-46. Danet, B., & Herring, S. C. (Eds.). (2003). The Multilingual Internet: Language, Culture and Communication in Instant Messaging, Email and Chat. Special issue of the Journal of Computer Mediated Communication, 9 (1). Retrieved October 1, 2005 from http://jcmc.indiana.edu/vol9/issue1/ Del Gado, E., & Nielsen, J. (Eds.). (1996). International User Interfaces. New York: John Wiley & Sons. Ess, C., & Sudweeks, F. (1998). Computer-mediated communication or culturally-mediated computing? Challenging assumptions of the electronic global village. The Electronic Journal of Communication / La Revue Electronique de Communication, 8 (3-4). Available from http://www.cios.org/getfile/Ess_V8N398 [requires membership in CIOS]. Ess, C. with Sudweeks, F. (Ed.). (2001). Culture, Technology, Communication: Towards an Intercultural Global Village. Albany, NY: SUNY Press. Eveland W. P., & Dunwoody, S. (2000). Examining information processing on the World Wide Web using think aloud protocols. Media Psychology, 3, 219-244. Faiola, A. (2002). A visualization pilot study for hypermedia: Developing cross-cultural user profiles for new media interfaces. The Journal of Educational Multimedia and Hypermedia, 11 (1), 51-71. Faiola, A. (2004). The second psychology of Vygotsky and Luria: Cross-cultural web design from a cognitive perspective. Proceedings of the International Scientific and Technical Conference and Russian School of Young Scientists and Specialists: System Problems of Quality, Mathematical Modeling and Information Technologies. Sochi, Russia, Part 2. Farnen, R. F. (1993). Cross-national perspectives on cognitive studies, problem solving, and decision making. In R. F. Farnen (Ed.), Reconceptualizing Politics, Socialization, and Education: International Perspectives for the 21st Century (pp. 376-460). Oldenburg: Library and Information Systems, University of Oldenburg. Ford, N., Wood, F., & Walsh, C. (1994). Cognitive styles and searching. Online and CDROM Review, 18 (2), 79-86. Goldstein, K. M., & Blackman, S. (1978). Cognitive Style. New York: Wiley. Goleman, D. (1998). Working with Emotional Intelligence. New York: Bantam. Goleman, D. (2001). An EI-based theory of performance. In C. Cherniss & D. Goleman (Eds.), The Emotionally Intelligent Workplace (pp. 27-44). San Francisco: Jossey-Bass. Greene, J. O. (1995). An action-assembly perspective on verbal and nonverbal message production: A dancer's message unveiled. In D. E. Hewes (Ed.), The Cognitive Bases of Interpersonal Communication (pp. 51 -85). Hillsdale, NJ: Erlbaum. Hall, E. T. (1966). The Hidden Dimension. New York: Doubleday. Hall, E. T. (1976). Beyond Culture. New York: Random House. Hara, N., & Kling, R. (1999). Students' frustrations with a Web-based distance education course. First Monday, 4 (12). Retrieved August 1, 2005, from http://www.firstmonday.dk/issues/issue4_12/hara Hartson, H. R., Castillo, J. C., Kelso, J., & Neale, W. C. (1996). Remote evaluation: The network as an extension of the usability laboratory. Proceedings of the Conference on Human Factors in Computing Systems (CHI'96) (pp. 228-235). New York: ACM Press. Herring, S. C. (Ed.). (1996). Computer-Mediated Communication: Linguistic, Social, and Cross-Cultural Perspectives. Philadelphia: John Benjamins Publishing. Hofstede, G. (1991). Cultures and Organizations: Software of the Mind. London: McGraw-Hill. Honold, P. (2000). Cultural and context: An empirical study for the development of a framework for the elicitation of cultural influence in product usage. The International Journal of Human-Computer Interaction, 12, 327-345. Kim, K. S., & Allen, B. (2002). Cognitive and task influences on web searching behavior. Journal of the American Society for Information Science and Technology, 2, 109-119. Larson, K., & Czerwinski, M. (1998). Web page design: Implications of memory, structure, and scent for information retrieval. Paper presented at the CHI '98 Human Factors in Computing Systems, Los Angeles. LeDoux, J. (1996). The Emotional Brain: The Mysterious Underpinnings of Emotional Life. New York: Touchstone. Liu, Y., Lin, F., & Wang, X. (2003). Education practice and analyzing behaviour of students in a web-based learning environment: An exploratory study from China. Online Information Review, 27 (2), 110-119. Lucy, J. A. (1992). Grammatical Categories and Cognition: A Case Study of the Linguistic Relativity Hypothesis. Cambridge, New York: Cambridge University Press. Luria, A. R. (1971). Towards the problem of the historical nature of psychological processes. International Journal of Psychology, 6, 259-272. Luria, A. R. (1976). Cognitive Development: Its Cultural and Social Foundations. Cambridge, MA: Harvard University Press. Marcus, A. (2000). International and intercultural user-interface design. In Constantine Stephanidis (Ed.), User Interfaces for All (pp. 47-64). New York: Erlbaum. Marcus, A., & Gould, E. W. (2000). Crosscurrents: Cultural dimensions and global web user interface design. Interactions, 2 (4), 32-46. Matei, S., & Ball-Rokeach, S. (2001). Real and virtual social ties: Connections in the everyday lives of seven ethnic neighborhoods. American Behavioral Scientist, 45 (3), 550-563. McDonough, J. (1999). Designer selves: Construction of technologically mediated identity within graphical, multiuser virtual environments. Journal of the American Society for Information Science and Technology, 50 (10), 855-869. Moore, M. G., & Kearsley, G. (1996). Distance Education: A Systems View. Belmont: Wadsworth Publishing Company. Nielsen, J. (Ed.). (1990). Designing User Interfaces for International Use: Advances in Human Factors and Ergonomics. New York: Elsevier Science Ltd. Nielsen, J. (1999). Designing Web Usability: The Practice of Simplicity. Indianapolis, IN: New Riders Publishing. Nisbett, R. E., & Norenzayan, A. (2002). Culture and cognition. In H. Pashler & D. L. Medin (Eds.), Stevens' Handbook of Experimental Psychology: Vol. 2: Cognition (3rd ed., pp. 561-597). New York: John Wiley & Sons. Nisbett, R. E., Peng, K., Choi, I., & Norenzayan, A. (2001). Culture and systems of thought: Holistic vs. analytic cognition. Psychological Review, 8, 291-310. Norman, D. A. (2004). Emotional Design: Why We Love (Or Hate) Everyday Things. New York: Basic Book. Preece, J. (2001) Online Communities: Designing Usability and Supporting Sociability. New York: Wiley. Picard, R. (1997). Affective Computing. Cambridge, MA: MIT Press. Riding, R., & Rayner, S. G. (1998). Cognitive Styles and Learning Strategies. London: David Fulton. Scherer, K. R. (1997). The role of culture in emotion-antecedent appraisal. Journal of Personality and Social Psychology, 73, 902-922. Scholtz, J. (1999). A case study: Developing a remote, rapid, and automated usability testing methodology for on-line books. Proceedings of the 32nd Annual Hawaii International Conference on System Sciences (pp. 2015-2025). IEEE Computer Society Press. Sears, A., Jacko, J., & Dubach, E. M. (2000). International aspects of World Wide Web usability and the role of high-end graphical enhancements. International Journal of Human-Computer Interaction, 12 (2), 241-261. Shweder, R. (1990). Cultural psychology: What is it? In J. Stigler, R. Shweder, & G. Herdt (Eds.), Cultural Psychology: Essays on Comparative Human Development (pp. 1-43). New York: Cambridge University. Steinberg, R. J. (2003). Cognitive Psychology (3rd ed.). Belmont, CA: Thomson. Tractinsky, N. (1997). Aesthetics and apparent usability: Empirically assessing cultural and methodological issues. Paper presented at the ACM CHI'97. Trompenaars, F. (1997). Riding the Waves of Culture: Understanding Cultural Diversity in Business. London: Nicholas Brealey. Vincent, C., & Camp, J. (2005). Looking to the Internet for models of governance. Ethics and Information Technology, 6 (3), 161. Vygotsky, L. S. (1979). Mind in Society: The Development of Higher Psychological Processes. Cambridge, MA: Harvard University Press. [Translated from the original text published in 1934.] Vygotsky, L. S. (1989). Thought and Language. Cambridge, MA: MIT. [Translated from the original text published in 1932.] Wheeler, D. L. (1998). Global culture or culture clash: New information technologies in the Islamic world — a view from Kuwait. Communication Research, 25, 359-376. Wood, F., Ford, N., Miller, D., Sobczyk, G., & Duffin, R. (1996). Information skills, searching behaviour and cognitive styles for student-centered learning: A computer-assisted learning approach. Journal of Information Science, 22 (2), 79–92. Zahedi, F., van Pelt, W. V., & Song, J. (2001). A conceptual framework for international web design. IEEE Transactions on Professional Communication, 44 (2), 83-103. Zebian, S., & Denny, J. P. (2001). Integrative cognitive style in Middle Eastern and Western groups: Multidimensional classification and major and minor property sorting. Journal of Cross-Cultural Psychology, 32 (1), 58-75.
is an Associate Professor of Informatics and
Associate Director of the Human-Computer Interaction Graduate
Program at the Indiana University School of Informatics, IUPUI. His
research focus is the relationship between cross-cultural cognition
and Web design and usability.
is an Assistant Professor of Communication, School
of Liberal Arts, Purdue University. His research focus is
socio-spatial shaping of communication technology, online social
interaction and communities, spatial analysis (Geographic
Information Systems) applied to communication systems, and
international communication processes and flows.
|
|||||||||||||||||||||||||||||||||||||||
| © 2005 Journal of Computer-Mediated Communication | |||||||||||||||||||||||||||||||||||||||