[originally posted fall 2014] About one year ago, I heard Gabriela Weaver present the results of a detailed study on the use of the flipped classroom in the majors chemistry course at Purdue. The course had been taught in the traditional format in fall, moving to the flipped format in spring with a different instructor, and the results overall were impressive. Her excellent seminar left me with two thoughts – first, that we should implement the flipped class at Marquette, and second, that it would be possible (and seemed best) to test the efficacy of the flipped class in a side-by-side comparison of lecture and flipped courses in our General Chemistry program. Thus began what I call the Flipped Classroom Project at Marquette. And so, in spring 2015 I will be teaching two sections of our General Chemistry 2 course, one in a traditional format (to some 200 students at 8 am) and a second in a flipped format (to around 120 students). The students will be given common exams, and while students are self-selecting into the courses as I write, all of the entering students will have taken the first-semester ACS exam, therefore benchmarking their entry point. Already there is a bit of a “buzz” around the flipped class, as I piloted this concept in our off-semester Gen Chem 2 course (around 70 students) this fall, and the two courses seem about equal in popularity in early enrollment. In upcoming posts I will share my experiences this semester, and what I’ve learned in implementing the flipped classroom concept. I would be thrilled to hear your suggestions on ways to implement this project so that the most meaningful data can be obtained, and any questions you might have. Thanks for reading! ... View more

[originally published 11/20/2015] [Originally published November 20, 2015] For the past year, we've been following the flipped classroom project at Marquette. The study used parallel classes taught by the same instructor, with students self-selecting into the traditional or flipped sections. The results of this study are now available electronically on the JCE site:   http://pubs.acs.org/doi/abs/10.1021/acs.jchemed.5b00717 Their study showed very little difference in higher-level students, but a marked decrease in the DFW rates between the two classes. This seems consistent with other studies as well as personal observation: Some students can perform well in chemistry no matter how the course is taught, but lower-level students benefit most profoundly from structured, active-learning environments.   Abstract Despite much recent interest in the flipped classroom, quantitative studies are slowly emerging, particularly in the sciences. We report a year-long parallel controlled study of the flipped classroom in a second-term general chemistry course. The flipped course was piloted in the off-semester course in Fall 2014, and the availability of the flipped section in Spring 2015 was broadly advertised prior to registration. Students self-selected into the control and flipped sections, which were taught in parallel by the same instructor; initial populations were 206 in the control section, 117 in the flipped. As a pretest, we used the ACS first-term general chemistry exam (form 2005), given as the final exam across all sections of the first-term course. Analysis of pretest scores, student percentile rankings in the first-term course, and population demographics indicated very similar populations in the two sections. The course designs required comparable student effort, and five common exams were administered, including as a final the ACS second-term general chemistry exam (form 2010). Exam items were validated using classical test theory and Rasch analysis. We find that exam performance in the two sections is statistically different only for the bottom third, as measured by pretest score or percentile rank; here improvement was seen in the flipped class across all five exams. Following this trend was a significant (56%) decrease in DFW percentage (Ds, Fs, withdrawals) in the flipped courses as compared with the control. While both courses incorporated online homework/assessments, the correlation of this indicator with exam performance was stronger in the flipped section, particularly among the bottom demographic. We reflect on the origin and implication of these trends, using data also from student evaluations. Congratulations to Michael Ryan and Scott Reid on the completion of this study. ... View more

[Originally published by John Osterhout on August 17, 2015]   I polled the students in my flipped General Chemistry II class to see what they found useful for their studies. At the beginning of the Spring 2015 semester, we made a list of things they could do to help themselves learn chemistry. At the end of the semester I asked them to rate the things that we discussed. Here are some of the results. This post is a follow up to my earlier post The Flipped Classroom: To Video or Not to Video. My Flipped Class After a class, I post a handout on Blackboard that contains the reading assignments and the learning objectives for the next class. The handout also contains a brief introduction (which few student read) and a list of vocabulary words. When I can find appropriate content, I provide links to videos. The videos that I have used include ChemTours (Norton), ThinkWell videos (Cengage) and Khan Academy videos (more about the videos later). Online homework covering the material in the reading assignment is due the night before each class. I assign on average about six problems, although the number varies depending upon the material. In class, the first exercise is a quiz that has five questions about the assigned material, two questions over the previous day's material and a bonus question that is extra credit. The students have been told that the first quiz question covers the first learning objective and so on down the list. The quizzes consist of the simplest possible questions that relate to the day's learning objectives. The role of the quiz is mostly to see if the students made any effort to internalize the learning objectives. The students work in groups of four for the quizzes and I observe that this engenders some lively discussions. After the quiz, I give the students a worksheet that contains more complicated problems. The worksheet is also done in groups of four. I spend the class time walking around the classroom helping the groups as requested. I post the answers to the quiz and worksheet questions on Blackboard. These became available a few minutes after the end of class. The next homework assignment contains problems from the previous class's material and from the new material for the next class. All of the sections of General Chemistry take group exams so the students are tested over the material on the same day using the same exam. The Poll Since there were no lectures or required video lectures, the emphasis was on the learning objectives. I tried to make it clear to the students in the beginning that it was up to them to figure out how to learn. At the beginning of the class, we listed off a set of resources that the student had at their disposal. The poll concerns which of these that the students used and which were useful. The question on the poll was: What did you do to help yourself? I asked them to rate each of the resources that we had discussed. There were five possible answers for each resource: A = Did not use, score = 0, B = Not useful, score = 1, C = A little useful, score = 2, D = Moderately useful, score = 3, and E = Most useful, score = 4. The average score = (0*A+1*B+2*C+3*D+4*E)/100. Forty-one students from my two sections of General Chemistry II took the poll. Not all of the students who were registered in the two classes took the poll. The Answers Rank Resources Score Use by Students(%) 1 Worksheets & keys 3.8 100 2 Daily quizzes 3.3 100 3 Study with other students 2.8 90 4 Internet 2.8 98 5 Online homework 2.7 100 6 Hard copy textbook 2.3 88 7 Chem tours 2.0 80 8 ACS Study Guide 1.8 59 9 Kahn Academy videos 1.8 71 10 Evening tutorial sessions 1.8 63 11 Self-identified videos 1.4 56 12 Office hours 1.4 49 13 Training Center 1.2 44 14 UC Davis Wiki 1.2 49 15 Thinkwell Videos 1.1 46 16 Online textbook 1.0 49 17 Office appointments 0.9 34 Notes on the resources: “Internet” was not further defined – it was meant as a catch-all for things internet but presumably not the tools named directly, such as Khan Academy Videos. The online homework was delivered the SmartWorks system from Norton. The textbook was Chemistry: The Science in Context, 4th Edition, Gilbert, Kirss, Foster, Daves, W. W. Norton & Compan, New York/London. The online textbook was delivered though the SmartWorks login. ChemTours were short (less than 10 minutes usually) animated tutorials on chemical topics assessed through the SmartWorks system. ThinkWell videos are longer, lecture-like videos from Cengage. Khan Academy videos were either assigned or found by the students. I gave two tutorial sessions per week for one hour from 5 pm to 6 pm on Monday and Wednesday and had four scheduled office hours 1-2 pm (before the chem labs) on Monday through Thursday. Office appointments were tutoring outside my regular office hours scheduled in advance by the students. The UC Davis ChemWiki was listed in the beginning as a resource. The Tutoring Center is run by Angelo State University, and usually has a chemistry tutor present. The Fate of Videos In my previous post, I asked “Do the students need to have knowledge spoken to them in order to learn?” During the Spring semester the students could use four different types of videos: ThinkWell, ChemTours, Khan Academy and other, self-identified videos. The videos were far down in the rankings: ChemTours (7th), Khan academy (9th), Self-identified (11th), and ThinkWell (15th). There seems to be a correlation here with length: the ChemTours were the shortest, the Khan Academy generally longer and the ThinkWell videos were forty-five minutes plus, covered big chunks of content, and were made to replace classroom lectures, which they strongly resembled. In talking with colleagues, I find that they echo this result: students won't willingly watch long videos outside class. In the beginning of my flipping experiments, my students complained bitterly that I didn't lecture. When provided with lecture-like videos, they won't use them.   The Most Useful – The Top Six Worksheets and Keys. I posted the keys to the daily worksheets immediately after the class ended. The keys provided examples of five or six worked out problems per day for the students. Many students made notebooks of the keys, some simply corrected their own worksheets. Daily quizzes. The keys for these were posted along with those for the worksheets. These also provided sources of problems to study. Study with other students. I meant this to mean “out of class” study with other students but many may have construed this as “group work in class” as well. Next time I'll make the choices more explicit. Internet. Where would we be without the internet? I know from talking with the students that they used the internet to search for solutions for their online homework, for explanations of the learning objectives, and for clarification of the textbook. Online homework. Talking to the students, you would think that the online homework was the work of the devil. Then it winds up in the top five—go figure. I use the homework to trap the students into engaging the material before they have the quizzes and worksheets in class. If nothing else, they must do some kind of preparation in order to be able to do the homework problems. The hard-copy textbook. Most of the students bought a hard-copy book. They all had access to the ebook through their online homework system. I was pleased to see that the textbook scored as highly as it did. As time stumbles on, I feel that the students are becoming less capable of or at least less willing to use books as learning tool.   The Least Useful – The Bottom Five The tutoring center. I was surprised that the utilization of the tutoring center (44%) was as high as it was, but a utilization of 44% had the effect of lowering the score, since "did not use" = 0 score. The UC Davis Chem Wiki. The students had a hard time navigating the wiki. They couldn't find the appropriate information by searching the wiki and when they did, the answers were too involved or the nomenclature was too different from the textbook to be useful. ThinkWell videos. As a professor, I think these are great. The students, not so much. The knock on these videos is that they are too long (45 minutes plus). Why forgo lectures in a flipped classroom if you just have to sit through them outside class? Online textbook. About four students brought laptops to class and used the online textbook in class. The rest brought or shared a hard copy book. There were a few students who tried to use their cell phones to access their textbooks, which proved difficult since the screen is so small and since I outlaw cell phone use in class. The big loser, office appointments. Two students used office appointments regularly because my regular office hours conflicted with their classes. The others would mainly drift in before the exams for a quick tune-up. Note on office hours in general: only one male came to my office hours during the entire semester. This has been my experience over a number of years and seems to the be the experience of others as well. The ratio of women to men in my evening tutorials was about 6:1.   Moving Forward I can correlate these data with the grades and with scores on the American Chemical Society final exams. I am sorting through the data now. I can tell you this: there is not a simple correlation between the number of resources used and the final grade. I will look at what the A and B students found useful and compare that to the student will lower grades. I'll let you know how it turns out. ... View more

If you have been following along with me during my flipping journey, then you are aware of a study in which two colleagues (Dr. Melanie Styers and Dr. Pete Van Zandt) and I wanted to assess whether or not flipped teaching promoted critical thinking within our students... but instead of me writing about it, we thought, in good flipped teaching manner, we would make some short videos to describe our project.. here is video one which describes who we are, and why we think critical thinking is important: Video Link : 1824 ... View more

[Originally published by David Rieck on July 7, 2014]   I started flipping some of the content in my general chemistry class about three years ago. When I began, my classes typically had a maximum of 44 students, but recently I have had classes of 66 and on one occasion 88 students. (Our lectures increase in 22 student increments because that is the number of students per lab.  Thus, adding one more lab section to a class increases the lecture by 22.) While there are certainly some obstacles to flipping larger classes, some of which are out of the instructor’s control, I find that it is still a useful and effective instructional method. In a flipped class, students watch the lecture on their own time, and then spend the class working problems in small groups. The students work through packets of problems progressing from very simple questions to more challenging problems.  The most significant difficulty I encounter in larger classes is making sure I give each group enough of my attention. With anywhere from 10 to more than 20 groups and a total class time that may be only 50 minutes, it becomes a mathematical certainty that some groups will get very little of my time. I am especially concerned that students might think they are doing things correctly when they are not, and they may continue working additional, more challenging problems when they have not mastered the basic concepts. Ultimately such students will run into trouble and they could end up confused and frustrated simply because I was not able to correct some simple errors or misconceptions before they advanced. One way to minimize this particular issue is by using clickers. During class I monitor students’ progress on the packets and when it looks like most groups are finishing a section of problems, I display a similar problem as a clicker question. Groups who answer incorrectly either figure things out on their own, or ask for help before proceeding. Usually only a few groups need help, but this way I can target my attention where it is most needed. The clicker questions definitely help, but I also discovered that fewer students need my help than I had anticipated. It seems that students not only work together within their own groups, but they are also usually very willing to help other groups nearby. I encourage this sort of inter-group association, and emphasize that this sharing of ideas and information is part of how science is really done – science is much more of a social endeavor than most people realize.  A few other difficulties are beyond my control so I just work around them as well as I can. For example, large classes are almost always in lecture rooms that are not designed for group work. It can be hard to get to groups in the middle of seating sections, but students seem to enjoy watching me climb over rows of desks to reach them when they need help. The obstacles I encounter flipping larger classes definitely change how class operates. Most obstacles can be minimized, and others just need to be dealt with as well as possible. In the end, however, even though it is different from a small class environment, I find classroom flipping to be effective, engaging and actually more fun than a traditional lecture. ... View more