If “well-read” means “not missing anything,” then nobody has a chance. If “well-read” means “making a genuine effort to explore thoughtfully,” then yes, we can all be well-read. But what we’ve seen is always going to be a very small cup dipped out of a very big ocean, and turning your back on the ocean to stare into the cup can’t change that.The Sad, Beautiful Fact That We’re All Going To Miss Almost Everything
I was chatting yesterday with friends Stuart Arsenault and Brian Peters about some partnership things. Stuart mentioned something interesting about “upside vs. downside potential” in relationship management. I thought this was an interesting way to frame things.
In some relationships, you’re trying to limit downside potential. For Shogun, this is our relationship with Shopify. Pretty much nothing we can do with that relationship will result in 1000 leads overnight. On the other hand, they could destroy our business over night if they decided they didn’t like us. Mostly, we’re trying to Not Fuck It Up™.
In other relationships, you’re trying to enhance upside potential. These are your new platforms, your new agency partnerships, your new integrations. Any of these (but definitely not all of them) can result in huge upside for your business, but it’s not the end of the world if any given one of them falls apart.
This feels like a helpful mental model for a bunch of decision making. Defining the type of relationship you’re working in will help you decide how much time and effort goes in to it, what types of activities you’ll do in the context of that relationship, etc.
Things to consider here still: the above examples of each are obvious – but once we get in to greyer territory, how do we identify where on the spectrum a relationship lands? Exactly how does that influence activities? What’s a fair and equitable split of your time among both types of relationships, given that they’re both important for different reasons?
In his book The Hard Thing About Hard Things, Ben Horowitz recounts a quote from his old boss, Jim Barksdale: “We take care of the people, the products, and the profits… In that order.”
Working on the App Store at Shopify, we operate under a similar philosophy: we take care of the merchants, the developers, and the App Store… In that order. Merchant’s experiences with the apps they install is paramount. If we don’t earn — and maintain — the trust of merchants, it doesn’t matter how developer’s feel and it certainly doesn’t matter if the App Store exists. Without merchant trust, developers don’t get installations of their app. Without app installs, the App Store has no purpose.
Merchants put a huge amount of faith in other merchant’s app reviews. Reviews also influence our ranking algorithm, which determines the long term success of an app, making reviews all the more important. Developers know this, and this knowledge has resulted in the pursuit of positive reviews at any cost. So much so, that occasionally, you’ll see reviews like these:
because it’s making me do this before I even try the app (3/5)
Jury still out … (1/5)
What we’re looking at in this example is an app that requires merchants to leave a review part way through a tutorial in order to advance. This is insanity — I truly have no idea how a developer thinks this is a good idea. Nevertheless, this is rampant, and it’s something that we’re taking very seriously. How can merchants trust anything — the reviews, the apps, the App Store — if this is what it’s turned into?
This week we took a fairly large step in maintaining merchant trust. We implemented a minimum character count for all reviews going forward (30 characters), and removed all reviews that don’t meet that standard. What does this look like? It’s removing about 18% of the almost 100,000 reviews across the App Store. It’s removing 0% of some app’s reviews, and 70% of others. There is a significant percentage of the removed reviews that are simply “great app” — that’s it. This isn’t helpful to other merchants, and it’s obvious that in almost every case, this review was obtained in a way that isn’t good for anyone.
It’s easy, when given a role like “Developer Advocate” or “Developer Relations”, to think that serving developers is what’s most important. It is my job to make sure developers are happy with our platform. I believe, fundamentally, that the best way to do this is to make merchants happy first.
Some developers aren’t happy about review removal — it’s interesting, because the ones I’m hearing complain are the ones who are having the most reviews removed. Maybe if they had focused on the people (the merchants), the product (the app), and the profits (the reviews), in that order… Things may have been different for them. I’m excited to continue rewarding the developers that build with a merchant-first attitude.
Thank you to Josh Gosse and Liz Couto for their editing help.
This post was also published on Medium.