Cognitive Theory of Multimedia Learning

How does Research Apply to Classroom Instruction?

Weeks 10-11

Cognitive Theory of Multimedia Learning: http://blogs.usask.ca/multimedia_learning_theory/

A summary of the main ideas, concepts, or principles of the theory.

For all intents and purposes, the first step in defining the cognitive theory of multimedia learning is to come to an understanding of what multimedia is and how it is used. One brief Internet search on the definition of multimedia will produce over 2.3 million hits. Therefore, narrowing the many definitions floating in research circles is near impossible. Simply, multimedia can be rationalized as any process involving more than one type of media; hence, multi – media. I speculate that with such a potentially broad definition, this is I found multimedia specifically defined for individual research.

One of many cases was how Mitchell (2003) defined multimedia for his student on student-generated multimedia on learning. He defined multimedia for the purpose of his study as “an educational presentation made using primarily audio and images. Unlike hypertext and web-based instruction, for example, the reliance on text is minimized (though not eliminated) in a multimedia product.” In my interactive media courses, I define multimedia as the use of multiple or mixed media in analogue systems, like slide shows or overhead projectors.

That said, why is the definition of multimedia so important in this learning? Without understanding what multimedia is, one cannot research its effectiveness in the learning process. In visual communications, we are taught that over 70% of all our sensory receptors are in the eye. Therefore, the idea of multimedia, in all its definitions, becomes apparent.
As an instructor of visual communications, defining and summarizing the cognitive theory of multimedia was almost a necessity. When reading through the documentation on this theory, I found myself referring back to my studies of the discipline. I was reminded of the teachings of Aldous Huxley when reading his theory of how sensing plus selecting plus perceiving equals seeing. The research of Richard Mayer, who I consider to be the first person to define the concepts of multimedia learning theory, also cites selecting as one of three primary cognitive processes that a person goes through when using multimedia for learning. “Selecting is applied to incoming verbal information to yield a text base and is applied to incoming visual information to yield an image base.” (Mayer & Moreno, 2000).

The foundation of the Mayer’s theory was based on Paivio’s dual-coding theory, where both verbal (audio) and visual codes, used for representing information, are used to organize information. In essence, these codes form this information into knowledge that can be utilized, filed away into memory and then retrieved at a later date.

Both visual and verbal codes for representing information are used to organize incoming information into knowledge that can be acted upon, stored, and retrieved for subsequent use. (http://coe.sdsu.edu/EDTEC640/Modules/module1/dualcoding.htm). However, both of these codes have their limitations and can get overloaded. Understanding this potential for ‘sensory overload’ is important for any multimedia designer to understand.

For example, if a Powerpoint presentation is being used for a lecture, automatically, there are some type of imagery, visual codes, and then there is text, which can be derived as verbal codes, as some people can translate that visual image into an internal audio signal. If then, audio effects are added to every slide or to each transition animation, the verbal code passage could get overloaded, which will ultimately defeat the learning process.

Image from: http://imej.wfu.edu/articles/2000/2/05/index.asp

A description of several specific ways that teachers could apply the theory to classroom instruction when they use the Internet or some Internet-based application.

Again, the implementation of this theory is greatly controlled by how multimedia is defined. By using my own definition of multimedia, as cited earlier, there are a number of ways this theory could be used in every day teaching methods, which utilize the Internet or Internet-based applications. “Digital representations enable creation of asynchronous instructional messages, which store information in a permanent form for anytime access.” (Snelson & Elison-Bowers, 2007)

Sciences
A study of meteorology utilizing the Internet for reinforced content and instruction. The use of Powerpoint to highlight text-based information could be supplemented by online maps in motion, informational graphics, and even movie clips of meteorologists. Information from the Internet could be referenced and reviewed at any time.

Technology
Obviously, technology would lend itself to be very adaptable to multimedia learning, as there are so many options in multimedia content development. Blackboard or WebCT could be used to add multimedia content to an online, asynchronous environment. Within a course management system (CMS), such as Blackboard or WebCT, text could be a primary option for delivering content. Information could be exchanged via use of a discussion board and visual presentations could be added to the CMS to assist in understanding the content.

English Literature
Multimedia could come in many forms in an English Literature course. For elementary or junior high teachers, after the text is read (one form of visual and audio codes), filmstrips and/or movies, which reference the novel at hand, could be viewed. In addition, just as with the other subjects listed above, Powerpoint and/or the use of a CSM would be very beneficial for displaying graphics and/or discussion.

Mathematics/Statistics
Aside from the obvious informational graphics, such as bar charts and line graphs, utilizing the Internet for the instruction of mathematics and/or statistics is actually quite useful. Here, a teacher could also use Internet-based applications, such as Flash, to create a lesson plan on the Internet.
http://www.danicamckellar.com/ ← A great resource for girls in junior high and high school.
http://www.primarygames.com/math.htm < style="color: rgb(153, 0, 0); font-style: italic;">Additional Resources

Mitchell, M. (2003). Constructing Multimedia: Benefits of Student-Generated Multimedia on Learning. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning.

Mayer, R. and Moreno, R. (2000). A Learner-Centered Approach to Multimedia Explanations: Deriving Instructional Design Principles from Cognitive Theory. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning.

http://tip.psychology.org/paivio.html

Snelson, C. & Elison-Bowers, P. (2007). Micro-Level Design for Multimedia-Enhanced Online Courses. MERLOT Journal of Online Learning and Teaching (Vol. 3, No. 4, December 2007).

I'm Tapped In...are you?

This was my first experience discussing in an online professional forum and I was not entirely sure what to expect. I was not aware of the number of resources available on this site, which was new to me. Prior to this course, I had not even heard of this resource.

However, before I dove in to an actual forum discussion, I wanted to first find out more about what Tapped In really was about and why this particular site would be beneficial to me. Initially, I thought Tapped In was just another Facebook or Linked In-type social or professional networking site, but it is definitely more.

Tapped In enables providers to offer high-quality online professional development experiences and support to more teachers cost-effectively. Through Tapped In, educators can extend their professional growth beyond courses or workshops with the online tools, resources, colleagues, and support they need to implement effective, classroom-centered learning activities. (http://tappedin.org/tappedin/web/about.jsp).

Apparently, Tapped In belongs to a group of online resources referred to as a MOO (multi-user, object-oriented environment). “A MOO is a text-based environment where users can hold conferences and discussions, open an office, create objects to decorate the office, and even adopt an office pet. At an educational MOO, or 'eduMOO', teachers and students can collaborate on projects, attend sessions hosted by experts, and build virtual environments.” (http://www.educationworld.com/a_tech/tech010.shtml).Tapped In offers online activities which all take place within virtual buildings. An organization can obtain their own building and each building can have three floors: 1) ground floor reception area (for help desk, news, etc.), 2) second floor with group rooms (public, moderated or completely private), and 3) a third floor with personal virtual offices for members who are affiliated with the particular organization. (http://tappedin.org/tappedin/web/about.jsp).

Tapped In is more than a professional network of educators. Initiated and ran by SRI International (formally known as the Stanford Research Institute), Tapped In offers schools and universities online options for teaching in asynchronous environments. “Tapped In offers TPD providers and other organizations the latest in online technology, along with the online learning strategies and support needed to use online technology effectively. Through Tapped In, organizations can develop, implement, and manage online courses, workshops, seminars, mentoring programs, and other collaborative activities that supplement, or function in lieu of, face-to-face activities.” (http://tappedin.org/tappedin/web/about.jsp).

The event I took part of this evening was a synchronous discussion in an online, instant messaging format. The topic of the evening was Cybersecurity and the group participating consisted of seven members. All of the members were, somehow, involved in education, most being in K-12. Based on some of the discussions, which ensued, I believe a couple of the students were still possibly completing their undergraduate studies.

The discussion did not go without its small issues. The discussion was set to last for one hour and, surprisingly, that hour went by rather quickly. This made for very brief discussions at times and I found myself wanting to further discuss an issue, like the future security of Web 2.0 technologies. The topics needed to be rushed through to cover all subjects and I thought that was actually unfortunate. Despite the fact that discussion sometime seemed a little forced and delays were occasionally pretty long, overall, the content of the discussion was quite valuable.

Though initially pretty negative about the value of such a discussion, I have to admit (happily) that I was incredibly wrong. It was quite interesting to take part in a conversation where all the participants seemed to be there because they chose to be. In addition, the convenience of having the entire discussion emailed to each participant so you can research external links provided during the discussion is brilliant! I am actually looking forward to participating in another discussion forum in the not-so-distant future! Now, if I can only figure out how to count this in my merit document for next year, I would be even happier!

In addition to the Tapped In environment, we were also exposed to another learning resource center called the Learning Times . The Learning Times is "a living, breathing and open community for eduction-minded people." The community appears to be composed of many different types of education professionals from all over the world. Much like Tapped In, the Learning Times allows for information sharing on all different types of topics ranging from social networking to RSS feeds to research to using proper grammar. The main difference between Tapped In and the Learning Times is that I did not see a lot of synchronous discussion forums being used at the Learning Times. Rather, much of the information is transposed in RSS feeds either through audio blogs, podcasts or vodcasts. There is significant opportunity to also participate in asynchronous discussion boards.

Overall, I think both of these online learning resources are great for professional development when travel to a workshop, training session or conference is not an option. At each site, educators are still able to collaborate with other professionals in their discipline and to share ideas and research. I believe I will find myself more frequently on the Tapped In resource center, but overall, I could see both being of value.