Showing posts with label evaluation. Show all posts
Showing posts with label evaluation. Show all posts

Tuesday, June 18, 2013

How and Why Should We "Pin" Public Health?


I regularly participate in the social media for public health (#sm4ph) twitterchat.  The chat (sponsored by the Public Health Management Corporation and hosted by Jim Garrow) explores various forms of social media use and how they impact (or could impact!) public health.  Back in March, the following question was posed to twitterchat participants:


At the time, I took note that several participants (including me) thought that Pinterest could be "the next big thing" (FYI: Pinterest is an online pinboard that allows users to create and share image collections):


Then this week, Nicole Ghanie-Opondo posed an important question to the field:  "Is Public Health Pinnable?"  She does a great job of breaking down all the "stuff" public health people want to pin (i.e., campaign posters, event information, staff photos) and analyzing why or why not it is a good fit for this particular communication channel.  She also emphasizes the key principle we need to remember and revisit in health communication:  

Think About Your Audience!  

When exploring any new communication channel, we need to review available data regarding the demographics and online behaviors of those users (whether it be Pinterest or Facebook or Twitter) and then tailor our content/strategies to those users.  The Pew Research Center's Internet & American Life Project is a great resource for social media user data.

In preparation for this post, I followed up with Nicole to see if she had received any feedback from public health colleagues on her post.  She shared the major theme from her (informal) feedback so far:  

Public health is not creating content to optimize pins.

I thought that was really interesting and it changes the conversation for me.  The question is not: "Should we use Pinterest- yes or no?"  There seems to be enough evidence that Pinterest is a promising communication strategy.  For instance we have: (1) strong interest in Pinterest from the field (as seen above), (2) available data on its users, (3) key audiences represented among users (e.g., women), and (4) colleagues that are successfully integrating this channel into their social media plans (e.g., CDC and Hamilton County Public Health).

Therefore, the question should become:  "How can we use Pinterest strategically in public health?"  This approach would require a discussion of the following questions:

  • What audience/s should we be engaging on Pinterest?
  • What kinds of content/images are most likely to be re-pinned or shared?
  • How can we optimize our content for pinning?
  • How are we evaluating our Pinterest efforts? (*Note that CDC's National Prevention Information Network (NPIN) recently had a wonderful webcast on social media evaluation. While Pinterest was not one of the featured channels, many of the concepts and resources would still be applicable.  The slides are available here).

Tell Me What You Think
:

  • Why (or why not) should we "pin" public health?
  • How should we "pin" public health?
  • What other planning questions should be considered?
  • Please share examples of Pinterest being used successfully (or unsuccessfully) in public health!

Monday, April 1, 2013

Writing Public Health Blogs: Do We Get Back What We Put In?


Last week I attended a great webinar hosted by AcademyHealth called: “Traditional and New Methods for Disseminating What Works”.  One of the speakers was Dr. David Kindig and he touched on the evaluation component of writing a public health blog- do we get back what we put in?  As the tweet below indicates, this is an important question for all of our blogs.


My exploration of this question nicely coincides with the theme for this week’s National Public Health Week- “Return on Investment”.  I was initially going to write just my own thoughts, but then decided it would be a much richer piece if I could incorporate input from other public health bloggers.  The following colleagues were kind enough to send me their thoughts:

Elana Premack Sandler: Promoting Hope, Preventing Suicide for Psychology Today
Jonathan Purtle: The Public's Health for the Philadelphia Inquirer

1. How much time do you dedicate to your blog per day/week/month?

Jim: I wish I could post more blogs per week; right now I'm averaging about a post a week (sometimes it'll be 3-4 posts in a week, sometimes no posts for a few weeks in a row). Each post takes about an hour between research, linking and writing. And I've got to be constantly on the lookout for new and time-relevant material.

Elana: When I was writing weekly, I spent 3-5 hours a week researching, writing, editing, and posting (using the content management software, sometimes the hardest part!). I have a background in journalism, so I'm able to write and self-edit relatively quickly. Now that I'm posting only once a month, I probably spend 5-7 hours a month between culling through stories of interest, thinking about the relevance of various topics, writing, editing, and posting. It's actually more challenging to post only once a month, as I get out of practice and have more material to comb through to see what rises to the top.

Jonathan: On average, a 500-750 word post takes me 4-5 hours. I currently post twice a month. I used to post weekly, but the time burden was too much. 

Michael: Approximately one hour per day, mostly devoted to writing my daily posts.

Thomy: I blog as part of my job as an Editorial Assistant/ Social Media Editor for the International Journal of Public Health. When I was focused only on the blog, I dedicated about 4 hours per week (divided between blogging and visiting other blogs/public health sites- to get ideas, keep informed and interact). Since I now also manage the twitter and Facebook accounts, I have reduced my blog time to 2-3 hours per week. 

Leah: I spend about 5 hours on each blog post- between finding the story, writing, and marketing the posts on social media. Since I try to address topics that are hot in the news that week or that day (like Jim says above), I'm constantly on the lookout for relevant stories.  Throughout the week I save all my possible stories/links/ideas on a spreadsheet and pick the best one.  While my posting frequency has varied over the past three years of writing Pop Health, my goal is to post at least once per week.

2. Who is the audience for your blog?

Jim: The blogs that I write are written for professionals in the fields of public health and emergency management. My thought is that I can affect more change by finding and teaching best practices to the people on the ground actually working with the public.

Elana: My blog is read by mental health and public health professionals as well as laypeople interested in psychology, mental health, pop culture, and suicide prevention. Since I blog on a site that does a lot of promotion for itself, I have a relatively wide readership. Each post can generate 500-2000 hits; I haven't done any real numbers-running, but 100-300 hits on the day the post is published is probably average, and then each post accrues hits over time.

Jonathan: The general public in Philadelphia and surrounding areas. Given the size of the health care sector in the region, I like to think health professionals read it as well. I also dream that policy makers read it—although I’m not sure if either health professionals or policy makers read Philly.com.

Michael: Incredibly diverse audience of anti-smoking advocates, groups, and researchers, smokers’ rights advocates, government agencies, tobacco companies, newspaper reporters, stock market analysts, consumers, trade groups, and policy makers.

Thomy: Originally, our intended audience was mainly public health students, as we are affiliated with the Swiss School of Public Health. However, especially through social media, our audience seems to be not only public health students and professionals but also people who just have an interest in public health. Nevertheless, it is not easy to know exactly who our audience is, as we do not get a lot of comments and it is difficult to know who actually reads the blog. We try to engage people to write guest posts for us. This generally works quite well.

Leah: I write for a broad public audience with an interest in public health, pop culture, or both. Therefore, I use it as a platform to breakdown and explain public health/communication concepts (e.g., "teachable moments"; "cue to action"). From the analytics, emails, and comments that I receive, I know that I have a large following among public health professionals, students, and teachers.  I have heard from more than one faculty member to say that they use my blog with their students to demonstrate the connection between public health and their everyday lives (e.g., movies, magazines, advertising).


3. What is the ideal “return/s on investment” for your blogging efforts? 

Jim: I've been writing blogs relevant to public health and emergencies for more than six years. I've found it to be one of the best investments I've made in my career, even with the huge investment in time and effort required for success.  I've found that the best return I've realized is my network of contacts and friends across the country and around the world; none of whom I would've met without being available and "out there" online.

Elana: For me, the ideal return on investment is reader engagement. I really get a lot out of seeing reader comments (the good and the not-so-good) and corresponding with readers via the comments section, or with friends and more personal connections on Facebook when I promote my posts there.

Jonathan: The ideal return is three-fold: (1) A public which understands that health is about more than just individual choices. A public which begins to see the reverberating impacts of social/economic policies, beyond the health care sector, on people’s health. A public which is knowledgeable about trauma theory and research on trauma/stress. (2) Networking. (3) Increased readership. While this is the most measurable, I’m not convinced it means all that much. Who’s reading? How are they reading? How is the information changing their perceptions? Is it at all? We have no idea.

Michael: The ideal “return on investment” is the blog having an actual impact on public policy.

Thomy: Increasing readership and dissemination of ideas is always a good return. We would ideally like to have more engagement in the form of interaction (e.g., comments). Networking is also quite satisfying and really helps broaden our blogging horizons. As a public health journal, we are also interested in disseminating our research articles.  I personally would like to see more and more public health students, researchers and professionals having blogs and engaging in social media to learn new things, disseminate their knowledge, “meet” interesting people and also –why not- for the fun of it!

Leah: Pop Health began as a hobby that just happened to incorporate my field of public health.  Now it has become a key part of my professional portfolio.  Therefore, the key returns are now different than three years ago.  Now, I'm looking for increased readership and referrals to my site.  I'm looking for increased dialogue with readers and colleagues.  I'm also looking for new and exciting professional opportunities (e.g., guest blogging, writing, and teaching) that can emerge by branding my expertise in this niche of public health.

4. Do you measure these “returns”?  If so- how?

Jim: I've seen a tremendous benefit professionally. As a direct result of my online identity and interactions, I've been invited to more than a dozen international, national and regional conferences to speak on those topics I blog about.  But even beyond those personal returns, I've seen a tremendous benefit professionally. Not only am I able to call on friends I've made around the globe to help with ideas for work, but I've grown as a result of being forced to flesh out my ideas. When I write about something, I want it to be well thought-out and considered. By writing these ideas out, I am forced to consider not only my idea, but how it affects other, larger problems...Without writing it out, I would just have a nugget of an idea, no more than that.

Elana: I measure this ROI very unscientifically. I notice which topics generate more interest (both in terms of hits, which are tracked by Psychology Today, and comments) either on the Psychology Today site or on Facebook. I've wanted to get more sophisticated with Google Analytics, but can't do that as I don't actually manage the website that hosts my blog. I've also enjoyed meeting people at professional conferences who recognized my name because of my blog. That really blew me away - it meant that I was really reaching people (not just my Mom!).

Jonathan: Philly.com tracks usage statistics and sends them to us on a weekly basis. Posts on animals, kids, and pop culture typically do the best.

Michael: Yes, but not formally. I assess the actions of public health agencies and organizations to determine whether the blog seems to be changing their thinking about these issues. I also assess the state of public opinion in the field regarding these issues.

Thomy: We keep track of visitors, time spent on blog (etc.) via Google Analytics and StatCounter. We also monitor the most popular posts and try to have some ongoing themes corresponding to these popular posts.  Regarding the “return on investment” to the Journal, we are trying to monitor whether articles that have been featured in the blog are downloaded more often from our website.

Leah: I have used Google Analytics and Blogger Statistics for measurements like page views, referring sites, and key words used to find Pop Health. I also take note of the posts that stimulate more engagement with readers- I would note that more dialogue seems to take place directly on social media where I market the posts (i.e., Facebook & Twitter) vs. the comment section on the blog itself.  As a result of the blog, I have also been invited to guest write on other sites like The Public's Health- so tracking those opportunities helps me to measure return on investment as well.

Evaluation and Return on Investment are key concepts in public health

With public health professionals constantly being asked to do more with less, it is imperative that we show how our investments are paying off. It is important to think of "investments" broadly- they are not just money...they are our time too.  As you can see from the responses to question #1, creating and maintaining a blog is a huge commitment.  And although we write for a variety of audiences with different goals (ranging from promoting research to trying to impact policy), we share the challenge of trying to evaluate those goals.

Therefore, we need to lead ongoing dialogue about the goals and evaluation of public health blogs. CDC's National Prevention Information Network (NPIN) is continuing its "In the Know: Social Media for Public Health" webcasts this spring and the June 4, 2013 event will focus on Measurement & Evaluation.  I look forward to continuing this discussion there and elsewhere.

Thank you again to Jim, Elana, Jonathan, Michael, and Thomy for your contributions!  I appreciate you making the time and sharing your experiences.

I would like to invite other public health bloggers to weigh in on these questions:  

  • How much time do you dedicate to your blog per day/week/month?
  • Who is the audience for your blog?
  • What is the ideal “return/s on investment” for your blogging efforts? 
  • Do you measure these “returns”?  If so- how?

Thursday, March 21, 2013

Baby on Board Badges May Reduce Awkwardness...But Can They Also Increase Safety?

Yesterday many media outlets were thrilled to report that Kate Middleton, Duchess of Cambridge received a "Baby on Board" badge during a visit to the London Underground (the city's subway system).  The badge initiative, first piloted almost a decade ago, was developed after internal research by Transport for London (TfL) showed that pregnant women often felt awkward or uncomfortable asking if they could sit down.  The research also revealed that most travelers believed that mothers-to-be should be offered a seat.  The developers hoped that the badges would give women confidence to ask for a seat and encourage fellow passengers to offer theirs without being asked.

In all the coverage of this initiative, I have (unfortunately) not seen any discussion of evaluation.  The badges are used broadly in London (and other countries like Ireland use them as well).  However, we do not know if they have successfully increased women's confidence to ask for seats or increased a non-provoked seat offer by their fellow travelers.  In addition to these goals, I wonder about how these badges could also be connected to the safety of pregnant women riding public transportation.

This week I had the pleasure of meeting a friend's 11-week old son.  She rode the subway to work all through her pregnancy and we discussed the potential risks that the ride entailed.  While she was comfortable with the ride, her co-workers were often worried about her choice of transportation.  What if she couldn't get a seat?  What if she fell?  What if someone fell into her on the crowded train?  My friend described the experience of having a student's backpack pressed up against her belly late in her pregnancy...which then prompted her to take an alternate mode of transportation to work the next day.

So what if the "Baby on Board" badges could do more than just reduce awkwardness for pregnant women and their fellow passengers?  What if this badge initiative could also reduce the number of pregnant women standing on crowded trains, putting them at risk for falls and other injuries?

First, we would need strong baseline data to determine if a public transportation prenatal injury problem even exists.  Then we would need to evaluate that data during and after the initiation of a badge program in the U.S.  We would also need to evaluate the effectiveness of the badges as a visual cue (e.g., Do passengers recognize the badges?  Do they understand what action they should take upon seeing the badges? i.e.,- giving up their seats).

What do you think?

  • Are you aware of research/studies on public transportation prenatal injury?  If so- please share!
  • For those readers/friends/colleagues that have ridden public transportation while pregnant:  Did you feel at risk for injury?  Did you ever suffer an injury?
  • What do you think about the potential for "Baby on Board" badges to prevent injury?  Are there other strategies that may be more effective?