The Risks of Over-Rewarding Communities
Incentive plays an important role in communities. We see it everywhere: community members are rewarded with extrinsic rewards such as t-shirts, stickers, gadgets, or other material, or intrinsic rewards such as increased responsibilities, kudos, reputation, or other benefits.
The logic seems seems sound: if someone is the bees knees and doing a great job, they deserve to be rewarded. People like rewards, and rewards make people want to stick around and contribute more. What’s not to love?
There is though some interesting evidence to suggest that over-rewarding your communities, either internal to an organization or external, has some potent risks. Let’s explore the evidence and then see how we can harness it.
The Research
Back in 1908, Yerkes-Dodson, psychologists (and potential prog rock band) developed the Yerkes-Dodson Law. It suggests performance in a task increases with arousal, but only to a point. Now, before you get too hot under the collar, this study refers to mental or physiological arousal such as motivation. The study highlights a “peak arousal” time which is the ideal mix of the right amount of arousal to hit maximal performance.
Dan Ariely in The Upside of Irrationality took this research and built on it to test the effect of extrinsic rewards on performance. He asked a series of people in India to perform tasks with varying levels of financial reward (very small up to very high). His results were interesting:
Relative to those in the low- or medium-bonus conditions, they achieved good or very good performance less than a third of the time. The experience was so stressful to those in the very-large-bonus condition that they choked under the pressure.
I found this choke point insight interesting. We often see an inverse choke point when the stress of joining a community is too high (e.g. submitting a first code pull request to your peers). Do we see choke points for communities members with a high level of pressure to perform though?
Community Strategy Implications
I am not so sure. Many communities have high performing community members with high levels of responsibility (e.g. release managers, security teams, and core maintainers) who perform with predictably high quality results.
Where we often see the ugly head of community is with entitlement; that is, when some community members expect to be treated differently to others.
When I think back to the cases where I have seen examples of this entitlement (which shall remain anonymous to protect the innocent) it has invariably been due to an imbalance of expectations and rewards. In other words, when their expectations don’t match their level of influence on a community and/or they feel rewarded beyond that suitable level of influence, entitlement tends to brew.
As as such, my graph looks a little like this:
This shows the Yerkes-Dodson curve but subdivides the timeline into three distinctive areas. The first area is used for growth and we use rewards as a means to encourage participation. The middle area is for maintenance and ensuring regular contribution over an extended period of time. The final area is the danger zone – this is where entitlement can set in, so we want to ensure that manage expectations and rewards carefully. In this end zone we want to reward great work, but ultimately cap the size of the reward – lavish gifts and experiences are probably not going to have as much impact and may even risk the dreaded entitlement phenomena.
This narrative matches a hunch I have had for a while that rewards have a direct line to expectations. If we can map our rewards to effectively mitigate the inverse choke point for new members (thus make it easier to get involved) and reduce the latter choke point (thus reduce entitlement), we will have a balanced community.
Things You Can Do
So, dear reader, this is where I give you some homework you can do to harness this research:
- Design what a ‘good’ contribution is – before you can reward people well you need to decide what a good contribution is. As an example, is a good code contribution a well formed, submitted, reviewed, and merged pull request? Decide what it is and write it down.
- Create a platform for effectively tracking capabilities – while you can always throw out rewards willy-nilly based on observations of performance, this risks accusations of rewarding some but not others. As such, implement an independent way of mapping this good contribution to some kind of automatically generated numeric representation (e.g. reputation/karma).
- Front-load intrinsic rewards – for new contributors in the growth stage, intrinsic rewards (such as respect, support, and mentoring) are more meaningful as these new members are often nervous about getting started. You want these intrinsic rewards primarily at the beginning of a new contributor on-ramp – it will build a personal sense of community with them.
- Carefully distribute extrinsic rewards – extrinsic rewards such as clothing, gadgets, and money should be carefully distributed along the curve in the graph above. In other words, give out great material, but don’t make it too opulent otherwise you may face the latter choke point.
- Create a distribution curve of expectations – in the same way we are mapping rewards to the above graph, we should do the same with expectations. At different points in the community lifecycle we need to provide different levels of expectations and information (e.g. limited scope for new contributions, much wider for regular participants). Map this out and design systems for delivering it.
If we can be mindful of the Yerkes-Dodson curve and balance expectations and rewards well, we have the ability to build truly engaging and incentivized communities and organizations.
I would love to have a discussion about this in the comments. Do you think this makes sense? What am I missing in my thinking here? What are great examples of effective rewards? How have you reduced entitlement? Share your thoughts…
Audio Interview: On Building Communities, Careers, and Traversing Challenges
Last week I was interviewed by the wonderful Eric Wright for the GC On-Demand Podcast.
Over the years I have participated in various interviews, and this was a particularly fun, meaty, and meaningful discussion. I think this could be worth a listen, particularly if you are interested in community growth, but also leadership and facing and traversing challenges.
Some of the topics we discussed included:
- How I got into this business.
- What great communities look like and how to build them.
- How to keep communities personal, particularly when dealing with scale.
- Managing the expectations of different parts of an organization.
- My 1/10/100 rule for mentoring and growing your community.
- How to evolve and grow the skills of your community members and teams in a productive way.
- My experiences working at Canonical, GitHub and XPRIZE.
- Increasing retention and participation in a community.
- Building effective leadership and leading by example.
- Balancing open source consumption and contribution.
- My recommended reading list.
- Lots of fun anecdotes and stories.
So, go and grab a cup of coffee, and use the handy player below to listen to the show:
You can also find the show here.
Eric is a great guy and has a great podcast. I encourage you to check out his website and subscribe to the podcast feed to stay up to date with future episodes.
Hack The World
As some of you will know, recently I have been consulting with HackerOne.
I just wanted to share a new competition we launched yesterday called Hack The World. I think it could be interesting to those of you already hacking, but also those of you interested in learning to hack.
The idea is simple. HackerOne provides a platform where you can go and hack on popular products/services (e.g. Uber, Adobe, GitHub, Square, Slack, Dropbox, GM, Twitter, Yahoo!, and many more) and submit vulnerability reports. This is awesome for hackers as they can safely hack on products/services, try out new hacking approaches/tools, build relationships with security teams, build a resume of experience, and earn some cold hard cash.
Currently HackerOne has 550+ customers, has paid over $8.9 million in bounties, and fixed over 25,000 vulnerabilities, which makes for a safer Internet.
Hack The World
Hack The World is a competition that runs from 20th July 2016 – 19th September 2016. In that time period we are encouraging people to hack programs on HackerOne and submit vulnerability reports.
When you a submit a vulnerability report that is valid, the program may award you a bounty payment (many people all over the world earn significant buckets of money from bounties). In addition, you will be rewarded reputation and signal. Reputation is an indicator of active activity and participation, and signal is the average reputation in your reports.
Put simply, whoever earns the most reputation in the competition can win some awesome prizes including $1337 in cash, a hackable FPV drone kit, awesome limited edition swag, and bragging rights as being one of the most talented hackers in the world.
To ensure the competition is fair for everyone, we have two brackets – one for experienced hackers and one for new hackers. There will be 1st, 2nd, and runner up prizes in each bracket. This means you folks new at hacking have a fighting chance to win!
Joining in the fun
Getting started is simple. Just go and register an account or sign in if you already have an account.
To get you started, we are providing a free copy of Peter Yaworski’s awesome Web Hacking 101 book. Ensure you are logged in and then go here to grab the book. It will then be emailed to you.
Now go and and find a program, start hacking, learn how to write a great report, and submit reports.
When your reports are reviewed by the security teams in the programs you are hacking on the reputation will be awarded. You will then start appearing on the Hack The World Leaderboard which at the time of writing looks a little like this:
So that’s the basic idea. You can read all the details about Hack The World by clicking here.
Hack The World is a great opportunity to hack safely, explore new hacking methods/tools, make the Internet safer, earn some money, and potentially be crowned as a truly l33t hacker. Go hack and prosper, people!
Reducing Texting and Driving: An Idea
This weekend I dropped Erica off at the airport. Driving through San Francisco we saw an inventive billboard designed to reduce texting and driving. Driver distraction is a big problem, with a 2012 study suggesting over 3,000 deaths and 421,000 injuries were a result of distraction. I am pretty confident those shiny, always connected cellphones are indeed a common distraction during a boring drive or in times when you are anxious for information.
So anyway, we were driving past this billboard designed to reduce texting and driving and it included an Apple messages icon with a message awaiting. It was similar to, but not the same as this:
While these billboards are good to have, I suspect they are only effective when they go beyond advocating a behavior and are actually able to trigger a real behavioral change. Rory Sutherland’s example of Scotland changing speeding signs from the number to an unhappy face, being a prime example – instead of telling drivers to drive more slowly, they tapped into the psychology of initiating that behavioral change.
When I saw this sign, it actually had the opposite effect on me. Seeing the notification icon with a message waiting caused a cognitive discomfort that something needed checking, tending to, and completing. You guessed it: it made me actually want to check my phone.
The Psychology of Notifications
This got me thinking about the impact of notifications on our lives and whether part of the reason people text and drive is not because they voluntarily pick up the phone and screw around with it, but instead because they are either (a) notified by audio, or (b) feel the notification itch to regularly check their phone to see if there are new notifications and then action them. Given how both Android and Apple phones both display notifications on the unlocked screen, this makes it particularly easy to see a notification and then action it by clicking on it and loading the app, and then potentially smash your car into a Taco Bell sign.
There is of course some psychology that supports this. Classical Conditioning demonstrates that we can associate regularly exposed stimuli with key responses. As such, we could potentially associate time away from our computers, travel, or other cognitive functions such as driving, as a time when we think about our relationships, our work, and therefore feel the urge to use our phones. In addition to this, research in Florida demonstrated that any kind of audio notifications fundamentally disrupt productivity and thus are distracting.
A Software Solution?
As such, it strikes me that a simple solution for reducing texting and driving could be to simply reduce notifications while driving.
For this work, I think a solution would need to be:
- Automatic – it detects when you are traveling and suitably disengages notifications.
- Contextual – sometimes we are speeding along but not driving (such as taking a subway, or as a passenger in a car).
- Incentivized – it is unlikely we can expect all phone makers to switch this on by default and not make it able to be disabled (nor should we). As such, we need to incentivize people to use a feature like this.
For the automatic piece some kind of manual installation would likely be needed but then the app could actively block notifications when it automatically detects the phone is above a given speed threshold. This could be done via transitional points between GPS waypoints and/or wifi hotspots (if in a database). If the app detects someone going faster than a given speed, it kicks in.
For the contextual piece I am running thin on ideas for how to do this. One option could be to use the accelerometer to determine if the phone is stationary or not (most people seem to put their phones in a cup holder or phone holder when they drive). If the accelerometer is wiggling around it might suggest the person is a passenger and has the phone on their lap, pocket, or in their hand. Another option could be an additional device that connects to the phone over bluetooth that determines proximity of the person in the car (e.g. a wrist-band, camera, sensor on the seat, or something else), but this would get away from the goals of it being automatic.
For the incentive piece, this is a critical component. With teenagers a common demographic, and thus first-time drivers, money could be an incentive. Lower insurance fees (particularly given how expensive teenagers are to insure), discounts/offers at stores teenagers care about (e.g. hot topic for the greebos out there, free food and other ideas could be an incentive. For older drivers the same benefits could apply, just in a different context.
Conclusion
While putting up billboards to tell people to be responsible human beings is one tool in reducing accidents, we are better positioned than ever to use a mixture of technology and psychology to creatively influence behavior more effectively. If I had the time, I would love to work on something like this, but I don’t have the time, so I figured I would share the idea here as a means to inspire some discussion and ideas.
So, comments, feedback, and ideas welcome!
Scratch Community Manager Position Available
A while back Mako introduced me to Mitchel Resnick, LEGO Papert Professor of Learning Research and head of the Lifelong Kindergarten group at the MIT Media Lab. Mitchel is a tremendous human being; warm, passionate, and terribly creative in solving interesting problems.
Mitchel introduced me to some members of his team and the conversation was focused on how they can find a good community manager for the Scratch learning environment. For the cave-dwellers among you, Scratch is a wonderful platform for teaching kids programming and the core principles involved.
So, we discussed the role and I helped to shape the role description somewhat.
It is a really awesome and important opportunity, particularly if you are passionate about kids and technology. It is a role that is calling for a creative thinker to take Scratch to the next level and impact a whole new generation of kids and how they can build interesting things with computers. While some community managers focus a lot on the outreach pieces (blogging, social media, and events), I encourage those of you interested in this role to also think of it from a deeper perspective of workflow, building different types of community, active collaboration, and more.
Check out the role description here and apply. If you and I know each other, feel free to let them know this and I am happy to share with them more about you. Good luck!
Building a Safer Internet with HackerOne
Recently I started doing some work with HackerOne and I thought many of you would find it interesting enough for me to share.
A while back my friend Mårten Mickos joined HackerOne as CEO. Around that time we had lunch and he shared with me more about the company. Mårten has an impressive track record, and I could see why he was so passionate about his new gig.
The idea is pretty neat: HackerOne provides a service where companies (e.g. Uber, Slack, General Motors etc, and even The Pentagon) can provide a bug bounty program that invites hackers to find security flaws in their products and services. The company specifies the scope of the program (e.g. which properties/apps), and hackers are encouraged to find and submit vulnerability reports. When a report is approved, the hacker is often issued a payment.
HackerOne is interesting for a few reasons. Firstly, it is helping to build a safer and more secure world. As we have seen in open source, crowdfunding, and crowdsourcing, a productive and enabled community can deliver great results and expand the scope of operations far beyond that of a single organization. This is such a logical fit when it comes to security as the potential attack surface is growing larger and larger every day as more of our lives move into a digital realm.
What I also love about HackerOne is the opportunity it opens up for those passionate about security. It provides a playground where hackers can safely explore vulnerabilities, report them responsibly, build experience and relationships with security teams at popular companies, and earn some money. Some hackers on HackerOne are earning significant amounts of money (some even doing this full-time), and some are just having a blast on evenings and weekends earning some extra cash while having fun hacking.
I am working with HackerOne on the community strategy and execution side and it has been interesting exploring the different elements of building an engaged community of hackers. One of the things I have learned over the years building communities is that every one is different, and that is very much the case for HackerOne.
Familiar Ground
More broadly, it is also interesting to see echoes of similar challenges that faced open source in the early days, but now applied to hacking. Back then the world was presented with the open source model in which anyone, anywhere, could contribute their skills and talents to improve software. Many organizations back then were pretty weirded out by this. They worried about their intellectual property, the impact on their customers, losing control, and how they would manage the PR.
Believe it or not, WarGames is not a documentary.
In a similar way, HackerOne is presenting a model in which organizations can tap the talents of a distributed community of hackers. While some organizations will have similar concerns to the ones back in the early days of open source, I am confident we will traverse those. This will be great for the Internet, great for organizations, and great for hackers.
Get Involved
If you are a hacker, or a programmer who would like to learn about security and try your hand, go and sign up, then find a program, and submit a report.
If you are an existing HackerOne user, I would also love to hear your feedback, thoughts, and ideas about how we can build the very best community. Feel free to send me an email to [email protected] – let’s build a powerful, engaged, global community that is making the world more secure and making hackers more successful.
Announcing Jono Bacon Consulting
A little while back I shared that I decided to leave GitHub. Firstly, thanks to all of you for your incredible support. I am blessed to have such wonderful people in my life.
Since that post I have been rather quiet about what my next adventure is going to be, and some of the speculation has been rather amusing. Now I am finally ready to share more details.
In a nutshell, I have started a new consultancy practice to provide community management, innersourcing, developer workflow/relations, and other related services. To keep things simple right now, this new practice is called Jono Bacon Consulting (original, eh?)
As some of you know, I have actually been providing community strategy and management consultancy for quite some time. Previously I have worked with organizations such as Deutsche Bank, Sony Mobile, ON.LAB, Open Networking Foundation, Intel and others. I am also an active advisor for organizations such as AlienVault, Open Networking Foundation, Open Cloud Consortium, Mycroft AI and I also advise some startup accelerators.
I have always loved this kind of work. My wider career ambitions have always been to help organizations build great communities and to further the wider art and science of collaboration and community development. I love the experience and insight I gain with each new client.
When I made the decision to move on from GitHub I was fortunate to have some compelling options on the table for new roles. After spending some time thinking about what I love doing and these wider ambitions, it became clear that consulting was the right step forward. I would have shared this news earlier but I have already been busy traveling and working with clients. 😉
I am really excited about this new chapter. While I feel I have a lot I can offer my clients today, I am looking forward to continuing to broaden my knowledge, expertise, and diversity of community strategy and leadership. I am also excited to share these learnings with you all in my writing, presentations, and elsewhere. This has always been a journey, and each new road opens up interesting new questions and potential, and I am thirsty to discover and explore more.
So, if you are interested in building a community, either inside or outside (or both) your organization, feel free to discover more and get in touch and we can talk more.
Moving on From GitHub
Last year I joined GitHub as Director Of Community. My role has been to champion and manage GitHub’s global, scalable community development initiatives. Friday was my last day as a hubber and I wanted to share a few words about why I have decided to move on.
My passion has always been about building productive, engaging communities, particularly focused on open source and technology. I have devoted my career to understanding the nuances of this work and which workflow, technical, psychological, and leadership ingredients can deliver the most effective and rewarding results.
As part of this body of work I wrote The Art of Community, founded the annual Community Leadership Summit, and I have led the development of community at Canonical, XPRIZE, OpenAdvantage, and for a range of organizations as a consultant and advisor.
I was attracted to GitHub because I was already a fan and was excited by the potential within such a large ecosystem. GitHub’s story has been a remarkable one and it is such a core component in modern software development. I also love the creativity and elegance at the core of GitHub and the spirit and tone in which the company operates.
Like any growing organization though, GitHub will from time to time need to make adjustments in strategy and organization. One component in some recent adjustments sadly resulted in the Director of Community role going away.
The company was enthusiastic about my contributions and encouraged me to explore some other roles that included positions in product marketing, professional services, and elsewhere. So, I met with these different teams to explore some new and existing positions and see what might be a good fit. Thanks to everyone in those conversations for your time and energy.
Unfortunately, I ultimately didn’t feel they matched my passion and skills for building powerful, productive, engaging communities, as I mentioned above. As such, I decided it was time to part ways with GitHub.
Of course, I am sad to leave. Working at GitHub was a blast. GitHub is a great company and is working on some valuable and important areas that strike right at the center of how we build great software. I worked with some wonderful people and I have many fond memories. I am looking forward to staying in touch with my former colleagues and executives and I will continue to be an ardent supporter, fan, and user of both GitHub and Atom.
So, what is next? Well, I have a few things in the pipeline that I am not quite ready to share yet, so stay tuned and I will share this soon. In the meantime, to my fellow hubbers, live long and prosper!
Kindness and Community
On Friday last week I flew out to Austin to run the Community Leadership Summit and join OSCON. When I arrived in Austin, I called home and our son, Jack, was rather upset. It was clear he wasn’t just missing daddy, he also wasn’t feeling very well.
As the week unfolded he developed strep throat. While a fairly benign issue in the scheme of things, it is clearly uncomfortable for him and pretty scary for a 3 year-old. With my wife, Erica, flying out today to also join OSCON and perform one of the keynotes, it was clear that I needed to head home to take care of him. So, I packed my bag, wrestled to keep the OSCON FOMO at bay, and headed to the airport.
Coordinating the logistics was no simple feat, and stressful. We both feel awful when Jack is sick, and we had to coordinate new flights, reschedule meetings, notify colleagues and handover work, coordinate coverage for the few hours in-between her leaving and me landing, and other things. As I write this I am on the flight heading home and at some point she will zoom past me on another flight heading to Austin.
Now, none of this is unusual. Shit happens. People face challenges every day, and many far worse than this. What struck me so notably today though was the sheer level of kindness from our friends, family, and colleagues.
People wrapped around us like a glove. Countless people offered to take care of responsibilities, help us with travel and airport runs, share tips for helping Jack feel better, provide sympathy and support, and more.
This was all after a weekend of running the Community Leadership Summit, an event that solicited similar levels of kindness. There were volunteers who got out of bed at 5am to help us set up, people who offered to prepare and deliver keynotes and sessions, coordinate evening events, equipment, sponsorship contributions, and help run the event itself. Then, to top things off, there were remarkably generous words and appreciation for the event as a whole when it drew to a close.
This is the core of what makes community so special, and so important. While at times it can seem the world has been overrun with cynicism, narcissism, negativity, and selfishness, we are instead surrounded by an abundance of kindness. What helps this kindness bubble to the surface are great relationships, trust, respect, and clear ways in which people can play a participatory role and support each other. Whether it is something small like helping Erica and I to take care of our little man or something more involved such as an open source project, it never ceases to inspire and amaze me how innately kind and collaborative we are.
This is another example of why I have devoted my life to understanding every nuance I can of how we can tap into and foster these fundamental human instincts. This is how we innovate, how we make the world a better place, and how we build opportunity for everyone, no matter what their background is.
When we harness these instincts, understand the subtleties of how we think and operate, and wrap them in effective collaborative workflows and environments, we create the ability to build and disrupt things more effectively than ever.
It is an exciting journey, and I am thankful every day to be joined on it by so many remarkable people. We are going build an exciting future together and have a rocking great time doing so.
Dan Ariely on Building More Human Technology, Data, Artificial Intelligence, and More
Behavioral economics is an exciting skeleton on which to build human systems such as technology and communities.
One of the leading minds in behavioral economics is Dan Ariely, New York Times best-selling author of Predictably Irrational, The Upside Of Irrationality, and frequent TED speaker.
I recently interviewed Dan for my Forbes column to explore how behavioral economics is playing a role in technology, data, artificial intelligence, and preventing online abuse. Predictably, his insight was irrationally interesting. OK, that was a stretch.