Intro
Hello and Welcome to our weekly update. This week's main focus was on Scrolller discoverability and creating the shareable favorites as a live feature for our users (as shared in the last newsletter), Creating an A/B test to see the impact of the account locking categories page, Designs for Extension in Scrolller features. If you are new to the newsletter, subscribe to keep up with our journey of building a 100 million MAU web application.
User Highlights
User Highlights this week spotlights 'Smoknz420'. Here's why. He pointed out a major discrepancy in our subscription system to alert users 'if a payment fails'. It's an important thing to inform a user that a payment hasn't been successful and it will downgrade their membership to a free tier and they'll start seeing ads. @Smoknz420, your feedback is a huge step towards helping us make Scrolller a great experience for all users. Thank you!
We are still extending an invite for users who would like to help us translate Scroller into Russian. If that's you, we'd like to meet you. Please sign up below. Thank You in advance!
Sign Up To Help → https://airtable.com/shrrRkFqMSZBqF24Q
To help us with Scroller Features testing, Go Here. We greatly appreciate your taking the valuable time to offer us feedback. Many thanks!
User Accounts
235428 → 238233
Account Creation Drop witch hunt
In last week's newsletter, we shared a few hypotheses that might point us in the right direction on why our user account creation rate dropped to half. We tested Hypotheses 1 and 2 and found out that they were both invalid as the tests didn't support the hypotheses statements.
Our best guess is that hypothesis 3 is the one that may be associated with the user account creation drop. To test it we have created an A/B test that will validate the hypothesis statement.
A/B Test To Confirm
We are creating a new A/B test where we can serve a sample of users with locked categories and the rest with the unlocked categories page. In this way, we can have essential data to compare and evaluate the hypothesis if user account creation is directly linked with the drop in signups.
Possible Issues With A/B Test
A couple of questions that arise with this sort of A/B test are:
Is it safe to serve Half of the users with the categories page as account locked and half as account unlocked? Will this give users an experience of a broken feature that sometimes works and sometimes doesn't?
At the moment we cannot track a non-logged-in user via google analytics because of incognito mode. We can't know if it is the same user and serve him the same experience. A user might be getting account-locked categories once and next time he might be getting non-locked categories.
Dealing With These Issues
Our data scientist has been tasked to find the answers to these questions and with the following :
Try to work out whether we can see if someone is getting unlocked categories (A) or locked categories (B) before they create an account and become premium.
Can we track users in incognito mode and how can we encourage users to use the normal mode rather than incognito mode.
Communicate various options to the team on how to resolve these issues.
What do you think about this A/B test? Please let us know in the comments if you think this sort of A/B test can affect user experience.
Impact of Pro-Metric Ads
To really pinpoint the impact of pro-metric ads, we wanted to evaluate it in terms of the dollar amount generated. The approach we used was to add an event in Google Analytics to track when a user clicks on the pro-metric ad. But when we tried to convert to a successful number of signups to get that dollar amount, we found that we are missing a very important piece in the puzzle. That piece is to track when a user successfully signs up on Scrolller. We have created an issue ticket that our developers will be working on a priority basis. By next week, we will have the essential data we need to find out whether our pro-metric ads added to the revenue.
Progress on Content Recommendation
As in the previous newsletter, we saw major progress on the content recommendation system. For this week, no major progress was made on it but we have developed the idea that how can we evaluate and fine-tune the model. At the end of this week, we will be able to fine-tune our model. After that, the only things missing are methods to access the system and a rough understanding of when to trust the predictions.
Current Step
Generate 10 great recommendations for our users based on their likes for content recommendation emails.
Next Steps:
Integrate the content recommendation system in scrolller as a "More Like This" feature.
Sexual Orientation Slider
Sexual Orientation Slider
In the process of providing our users with the content of their own sexual preference, we have decided to add the sexual orientation slider and interests in the user profile. Users can set that up in their account and the setting will take effect as soon as they sign in.
We believe that having this sort of feature will increase the user's interest in the content and will improve the overall session duration for our users.
In the old Scrolller, we used to have a pseudo-sexual orientation selector which was not very sophisticated. By having a content recommendation system in place we will have a powerful sexual orientation slider that will produce recommendations based on the sexual interests of the user and the content served will be more interesting and engaging to users.
We created some designs on how we can accommodate sexual orientation sliders in user account details.
Roadmap for Growth for User Accounts
Pro-Metric Advertising (In Progress)
Content Recommendation (In Progress)
Categories Feature Update + Unlock (Blocked)
Scrolller APP (Back Log)
Revenue
Premium CTA Popups
Right after the launch of premium CTA popups, we saw a growth in our daily premium subscribers by almost 100%. Previously, our average number of premium signups stood at 8, and now it is at 16 users per day. We found it a very good return on investment. For anyone looking to try this technique in their product, we would suggest definitely go for it.
A/B Testing Copies for Premium CTA Popups
For the A/B test, our developers created the new labels inside google analytics to track the performance of each copy. We deployed it on Monday so we don't have enough essential data to find out what copy works best. We will give it a whole week and analyze the data at the end when we have a good enough sample size to make necessary decisions. We are also looking into creating a system where we can test numerous copies at once rather than doing it in pairs.
Next week we will share the results of this A/B test and what decisions we took off that data.
Exclusive Features for Premium User
In the last newsletter, we discussed giving our premium customers some exclusive features. We finally started designing and evaluating features that can be good to provide our premium users value for their money, while enticing free customers to upgrade to premium ones.
Our priority is to implement the missing features for premium users by providing them with faster hosting to have a better experience of scrolller.
We also brainstormed some ideas for exclusive features that we should introduce first. We are still in the brainstorming phase and we will start working on these features with a proper plan.
Improve to the source link
We will upgrade our web scrapers and start finding all of the content that has the source material available. Right now, our source link goes to RedGifs or Reddit, but for premium users, it could go directly to the full version.
Premium content
We want to work with content companies to get premium content that only premium members can view.
Premium users will be able to watch the premium content in Long-form and higher quality.
Translation of scrolller into Russian
Traffic from Russia has exploded and now represents 20% of monthly users on Scrolller.
We are looking to Hire a Russian translator for the translation of Scrolller to Russian.
Some other notable exclusive features that are under planning and review
These features are looking like that they can add a lot of value to a premium subscription.
Premium users can upload and share their own content
Featured images in the following section
Allow premium users to monetize their uploaded content
Avatars and achievements badges for profile Picture
As you guys are part of our Scrolller journey. We would love to hear out which ideas you liked the most and which features should be included first.
Roadmap for Growth in Revenue
Exclusive Features for Premium User (Design Stage)
Completing current Premium Feature Set (Design Stage)
Social Traffic
User Generated Collections Progress
Work on user-generated collections is on track. We believe that by this weekend it will be in the testing phase. The major target of this user-generated collection is to encourage users to share the content on social media. It will help drive traffic from popular social media to Scrolller.
Backend Progress: Kotlin query to get shared follows is done and tested. TS-server which manages collections is also done. SQL tables on scrolller_dev are also ready. Frontend Progress: On the front-end managed to fetch both shared follows and favorites. Have some issue with displaying though. Leaderboard right now is a simple query, left to be done last.
Next Steps:
Shareable Following collection
Leaderboard
Incentives for top 100 users in the leaderboard.
Social Media Update
In our last social update, we mentioned we have started linking with different groups and pages that share similar content to ours so that we can expand our reach. Well, we did that and it has boosted our page reach. This week, people reached on Facebook reached 4.5k while Instagram and Twitter reached 8.9k and 3.3k respectively. We got an average of 10 more followers for the social channels. We'll continue to create and post content that our fans and followers like in a bid to increase traffic and engagement. If you have yet to check out our social media pages, your like and follow counts. Please see our social links below.
Instagram:
https://www.instagram.com/scrolllerofficial/
Facebook:
https://www.facebook.com/ScrolllerOfficial
Twitter:
https://twitter.com/ScrolllerForYou
If you can share and help us with any social media growth strategies that have worked for you, you are welcome and we'd love to hear from you. Looking forward to it in the comments section.
Roadmap for Growth in Social Traffic
User Generated Collections: Create and share your favorites and follows (In Progress)
Facebook Automation (Back Log)
Twitter Automation (Back Log)
Team Highlights
On Team Highlights, we look at what Scrolller Team members were busy doing this week. Let's get to it!
Mannan was Dev Testing a couple of issues reported by users and trying to reproduce them. He's also working on finalizing exclusive options for premium users by exploring multiple platforms.
Lavanya was busy revising the 'Show Auto Play Feature' as well as animating and editing 'Show off Community' videos.
Matt worked on A/B Testing and has embarked on researching both GA and A/B testing
Tim was into analytics, parameter tuning and system evaluation
Marité was working on fine-tuning UX/UI comments and notifications features as well as reworking the Scrolller headers
James was working on shared favorites frontend implementations
Karol was functioning the front-end component to display collections and setting collections tables on Scrolller DB to ensure items are fetched properly
Chris was looking into DevOps and Email Automation Hire, Scrolller Team progress and got plans to reach out to potential investors. He also makes sure the weekly update is ready for you with the help of Betty and Mannan.
What do you enjoy most on Scroller? Please let us know in the comments sections. We love hearing from our users!
Road Map
You can share feedback with us about any of the new features below. Using this Airtable Form. Looking forward to your comments
Notice - Old Scrolller Turning Off:
The team has decided since all the features of the old scroller are added and enhanced in the current scrolller, running the previous version is using the necessary resources which can be utilized in the betterment of the current scrolller.
By August 31, 2021, old.scrolller.com will be turned off
All the traffic that is landing on the old Scrolller will be redirected to scrolller.com on the respective page that they're trying to access.
This week
Improve quality and user experience of pro-metric advertisements (In Progress)
User Generated Collections: Create and share (In Progress)
Content Recommendation (In Progress)
Turning off old scrolller (In Progress)
Categories page for SFW collections + Unlock (Blocked)
New native advertisements (Back Log)
Monetization Update and Optimization (Back Log)
Enhancements to Auto Scroll Feature (Back Log)
P.S. As a reminder, subscribe to our newsletter if you are yet to, walk with us on this Building Scroller exciting yet challenging journey.
Also:
Sign Up To Help → https://airtable.com/shrrRkFqMSZBqF24Q us translate Scroller to Russian.
To help us with Scroller features testing, Go Here
Until next time, happy scrollling!
The word "straight" is spelled wrong in your screen-shot under NSFW "Sexual Orientation". You have it spelled as "Straigth".
I really like new design of settings