Assessment for a 1 shot session – STS

Demonstrating Success through Assessment: Don’t Leave Outcomes to Chance – STS

With Dominique Turnbow, UCSD Librarian

1) Title: First write the learning outcomes, then plan the rest: assessment to make one shot sessions successful

2) Abstract (150-250 words):

Many librarians know that assessment should be a part of the planning process for instruction; however it is usually an afterthought. Well-written learning outcomes can lead to thoughtful, effective assessment and sound instruction. Learning outcomes that focus on goals that aren’t possible to measure during a one-shot workshop can lead to a feeling that assessment and instruction isn’t working. In these situations, outcomes likely focus on behaviors that should be assessed summatively and only after the learners have had practice (i.e. database searching techniques). Instead, most one-shot outcomes should focus on formative assessment, that is, behaviors that can be reasonably observed during the workshop.

This presentation will raise awareness about how to write formative learning outcomes for in-person instruction for large classes without computers and in computer labs, as well as for online instruction. The presenters will discuss concrete examples that have been used in science classes (primarily biomedical). This presentation will include best practices for:

  • using different assessment techniques such as the “one minute paper,” “muddiest points,” and survey tools, such as Google Forms;

  • employing clickers when you don’t have a computer lab; and

  • creating assessment for online learning.

Participants will leave with a solid understanding of formative and summative assessment, concrete examples of outcomes that can be used in one-shot library sessions or online and assessment strategies to address them.

 

how to read a journal article

still working on using more of this excellent post on teaching students “How to read and understand a scientific paper.”
<http://violentmetaphors.com/2013/08/25/how-to-read-and-understand-a-scientific-paper-2/>

I used parts of it to inform quiz questions that asked students to read parts of an 8 page article in preparation for a large lecture class where we’d be talking about researching concussions (see especially question 3). More context in the prep for lecture 1, HPHY 212 class.

 

hoax websites are problematic as instruction sessions

as are having students fill out a grid and the whole CRAAP, etc thing just sort of embarrasses me. Also, I can never remember what everything stands for and what the differences are. These folks have a MUCH better way to go:

Benjes-Small, C., Archer, A., Tucker, K., Vassady, L., & Resor Whicker, J. (2013). Teaching Web Evaluation: A Cognitive Development Approach. Communications In Information Literacy, 7(1). Retrieved March 6, 2014, from http://www.comminfolit.org/index.php?journal=cil&page=article&op=view&path%5B%5D=v7i1p39

Especially Appendix A:
Benjes-Small_snap

ALA Midwinter

or Philly really isn’t so bad, even if it’s cold. Working the STS angle mostly so far, with Council meeting on Friday and the All Committee meeting this morning. I’ll head to the Hot Topics, where I’ll learn more about altmetrics.  [Update: flying home early as my dear elderly MIL passed away, but you should check out these:] Tomorrow learning about packaging e-resources. I’m hopeful that I’ll know more about the different platforms for electronic books and journals if I go. I’m curious to see what comes of the 1pm STS unconference as well.

If you want to be an STS mentor sign up here. I’ve gotten so much from my mentor/mentee relationships over the years.

Also, the ALA published Guide to Reference is really wonderful. You should use it and buy the print sections when they start rolling out.

 

Classroom activities from the Science Literacy Program

A list of the kinds of pedagogical techniques they covered this term. It’s a long list and I’ll try to add some annotations:

Clickers – Ready, Set, React: Getting the most out of peer instruction using clickers http://www.cwsei.ubc.ca/Files/ReadySetReact_3fold.pdf
The Clicker Resource Guide: (http://www.cwsei.ubc.ca/resources/files/Clicker_guide_CWSEI_CU-SEI.pdf)
CWSEI has some great resources on its Clicker page (http://www.cwsei.ubc.ca/resources/clickers.htm)

C.R.E.A.T.E.- Hoskins, SG. 2010. “But if it’s in the newspaper, doesn’t that mean it’s true?” Developing critical reading and analysis skills by evaluating newspaper science with CREATE. The American Biology Teacher 72(7): 415-420. Available from: http://www.bioone.org/doi/pdf/10.1525/abt.2010.72.7.5

Peer Led Team Learning

Think-Pair-Share – http://www.theteachertoolkit.com/index.php/tool/think-pair-share

Brainstorming

POGIL – designed for Chemistry, now Biology and biochem – can it be adapted to other disciplines?

https://pogil.org/resources/curriculum-materials/classroom-activities

Scaffolding

Student Discussion

Concept Mapping

Case Studies

One-minute Papers – I usually do this just at the end of class, but wonder if more regular check ins would be helpful, like what’s shown here:

http://www.theteachertoolkit.com/index.php/tool/one-minute-note

Lecture

Strip Sequence – give students a list of answers and have them put them in the correct order. Large classes: use multiple choice questions to do this, with new clickers can vote on which one to put first, second, etc.
try for peer review process, life cycle of information, hierarchy of evidence

Pre/Post Questions

Whip Around – http://www.theteachertoolkit.com/index.php/tool/whip-around

Handraising

Ask Open-Ended Questions

Learn Before Lecture Activities

Portfolios/Journals/Blogs

Screencasted Videos

Problem-Based Learning

External Brains

Field Trips

Interactive Lecture Demonstrations

Garage Demos

In Class Problem Solving

Comics

Service Learning

Reading lists are here (I was looking at this at the end of Fall 2013): http://scilit.uoregon.edu/recent_meetings.html

GWLA Student Learning Outcomes

From the UNLV conference November 2013

Curriculum mapping from UNLVs impressive efforts – instruction framework

Kansas State University is using qualtrics for their instruction efforts. That’s right, QUALTRICS. See Melia Fritch‘s work and especially the qualtrics quiz.

Flipping is the new embedded. The word is being used a lot and being used to mean a lot of different things.

Other hot topics include : threshold concepts, cognitive something, concept based learning
Backwards design – start with what you want them to know, design instruction from there
Core ideas – conceptual ideas not just thresholds.
New ACRL IL standards will include:
Disposition (of the librarian) , skills, knowledge

Storify summary here.

ACRL information literacy standards and Blooms taxonomy

Am I the only one who thinks these things should somehow map to each other more easily? It says that you can figure out which ones are higher order and which are lower order in the different outcomes. Wouldn’t it make sense to either list them hierarchically or be more explicit about which are which?

http://www.ala.org/acrl/standards/infolitscitech
and
http://edweb.sdsu.edu/courses/EDTEC470/sp09/5/bloomstaxanomy.html

There’s this literal mapping of the Standards with notes about the taxonomy covered, but it’s mostly for a curriculum review and it’s specific to the university that created it.

I should check out the digital taxonomy: http://edorigami.wikispaces.com/#Bloom’s%20Taxonomy

and do a literature search, these look promising:

[maybe] Koufogiannakis, D., & Wiebe, N. (2006). Effective methods for teaching information literacy skills to undergraduate students: a systematic review and meta-analysis. Evidence Based Library and Information Practice1(3), 3-43.

Callister, P. D. (2010). Time to Blossom: An Inquiry into Bloom’s Taxonomy as a Means to Ordered Legal Research Skills. Law Lib. Journal102(2), 191-218.

Keene, J., Colvin, J., & Sissons, J. (2010). Mapping student information literacy activity against Bloom’s Taxonomy of cognitive skills. Journal of information literacy4(1), 6-21.

visual representations

Concept mapping:
http://serc.carleton.edu/NAGTWorkshops/assess/conceptmaps.html

There are tools to make info graphics on these sites, but I find them frustrating:

http://visual.ly and http://infogr.am [is there a way to search these and I'm just confused?]

make words into a picture is a step…

Pinterest holds some promise as a search tool, but it’s not what I need for creating things.

If you have any ideas, I’m interested.

 

google like a librarian

Anyone know if these work still? How have you used them?

http://www.googleguide.com/advanced_operators_reference.html

http://www.hackcollege.com/blog/2011/11/23/infographic-get-more-out-of-google.html

http://emilysingley.net/are-you-a-good-googler-teaching-google-literacy/

also:

https://www.google.com/insidesearch/tipstricks/ace-a-class.html

I’ve mostly shown students that there is a google scholar and how to use the library links part.

Showing off a site:xxx.edu/gov search has worked well, as has the format: command.

Recently, I wanted to show a class the link: command and had a bit of a fail.

teaching portfolio

Will copy this as exactly as possible as soon as I have a minute.

https://sites.google.com/a/sjfc.edu/michelle-dubaj-price/events/nurs436