Loading...

The Empowerly Score

A “credit score” for college apps

A credit score for college apps

Do you remember what college apps was like for you, the constant pressure and the fear of the unknown? Today, the expectation for kids to “succeed” is higher than ever, causing undue stress and anxiety. With admissions rates at top colleges hovering at around 5%, the competition only gets worse. Recently, the situation has been exacerbated by controversial admissions practices whereby elite colleges lure unqualified candidates into applying, just for the sake of lowering acceptance rates.
/ BACKGROUND
With this in mind, the CEO’s ask was to design a tool whereby students can “punch in all their numbers and stats” to reveal a score that pin-points their strengths and weeknesses vis-à-vis the schools that they are applying to. This case study is about how I led the research, design, and development of this product.
/ THE ASK
This game-changing feature became a unique value proposition of Empowerly. For Empowerly’s class of 2020, the Empowerly score correctly ‘predicted’ the admissions results of 8.5 out of 10 applications. It received a satisfaction rating of 90% and expedited the successful closing of $12M VC fundraising deals as of 2022.
/ THE OUTCOMES
Responsibilities
User Research, Algorithm Design, UI Design, Interaction Design, Product Management
Tools
Adobe XD, Airtable, Google Sheets
device or platform
Web app
timeline
6 Months, Jan – Jul 2020
team
Solo Designer, 1 Subject Matter Expert, 2 Engineers

Background

A little bit about the problem space and the product idea

01
The problem
/

How might we help high-achieving students feel less like they are shooting applications into the dark?

1

Students are burnt out

Due to extreme competition and admissions uncertainties, high-achieving students write 12-20 college essays and submit 20-30 college applications, leading to extreme burn-out.

2

The company needed to standardize student experience

Empowerly was unable to track their students’ progress in the portal due to lack of engagement with the digital portal. On the other hand, not all counselors had equal experience in college admissions and were able provide the same level advice, since some were more geared towards industry mentorship.

3

The student portal lacked a strong core feature

The student portal was suffering from feature bloating without a central focus. There were some resource directories, calendars and to-do list tools but it didn’t give students or counselors a strong reason to ever log in.

02
The empowerly score, explained
/

What is the Empowerly score?

While there are many college apps “chancing calculators” out there, the Empowerly Score is unique in the following ways:

1

A score that measures the college application strength of a candidate.

2

Takes into account the “intangible qualities” found in extracurriculars and essays.

3

Helps students focus their time and energy on what matters the most.

If you are concerned about how such a feature might have an impact on a minor’s mental health, you are not alone. Mental health became a huge consideration, and it was therefore really important that we build in mechanisms that provided reassurance as well as trustworthy and actionable feedback.

03
the solution
/

How does the Empowerly Score help?

1

Empowers students know what’s in their control

By showing students where they could improve and what their strengths are, as well as which colleges they were an ideal candidate for at any given time, they could determine how best to spend their time and feel less stressed.

2

A central standard for college counseling services

The Empowerly Score gamifies the college application process, and encourages students and counselors to log all their information in one place for tracking purposes. It also informs all counselors on how college admissions work and gives them a level playing field.

3

A backbone for the student portal

The Empowerly Score helps ties all the disparate functionalities of the portal (essay edit, research requests, goal-setting etc.) together to address one common user goal — getting a predictive score.

Process

As the solo in-house design and product hire, I wore many hats—from designing the algorithm to managing the Sprint schedule. The boundaries between design, product, and research in this project was blurred.

01
The student persona
/

Empowerly students were much more stressed than average American students.

Having collected 100 survey responses, I observed that Empowerly students have a very different persona from general US students, in that they are much more burned out.

Realizing how different the two types of high school students are, we decided focus on serving the needs of our current Empowerly students first (since we knew them better), instead of rushing to expand the market.

After interviewing 10+ Empowerly counselors and students, we've learned that to students and their families, the value of counselors is their purported ability to shed light on the admissions process. Yet even with Empowerly’s counselors, students were still over-applying to schools due to sense of insecurity. Many were submitting 10-20 applications.

The average american student mostly claimed to experience a low level of ”fear of rejection”, whereas Empowerly’s students, who are mostly hyper competitive, reported a great ”fear of rejection” and were most burnt out.

02
the process
/

Core product values: transparent, reliable, accurate.

From researching competitive projects (colloquially referred to as “college admissions chancing calculators”), I noticed this: even if a product has the most beautiful interface, users will quickly abandon it if they find the results unreliable or downright meaningless.

In other words, for the Empowerly Score needs to be transparent, reliable, and accurate.

Since the accuracy of the Empowerly Score results is so critical, we decided to make sure we got the algorithm right first before moving on to the interaction and visual design.

The following diagram shows the different stages of the design and development process. At each stage, we delivered an output — whether that be an algorithm, a prototype, or a final product, and then tested them with users with the specific questions in mind. If the answer was "no," then we would move back a step and iterate. If we were satisfied with the outcomes, then we would move forward.

Spreadsheet
Internal tool
Hi-fi prototype
Staging
Algorithm design
back end dev
UX/UI design
Front end dev
Launch
Do the numbers make sense?
Do the students find the score valuable?
Is this feature intuitive to use?
Are customers actually using this?

Prior to designing the hi-fi wireframes, I led efforts in:

Designing the algorithm on a spreadsheet by guiding counselor input;

Handing the spreadsheet off to engineers to build a live data prototype;

Using the live data prototype in real-life scenarios to gauge authentic user reactions;

Validating the product idea and iterate on the algorithm.

03
Designing the algorithm
/

The prototype was a spreadsheet

Based on my research, I helped build a series of formulas on Excel that computed the Empowerly Score. I used this spreadsheet in a series of usability tests to validate the usefulness of the score before moving further with the design.

During live-data prototype testing, students who retrieved a score gave it a usefulness rating of 90%. However, seeing the actual number of the Empowerly Score was stressful to them as it is very honest about their current standing.

I was stressed at first, but I also feel a sense of relief because after talking through it, I think by senior year, I’ll have everything prepared.

— Kelli (Sophomore)

04
Designing the UI
/

Can designing for a more meaningful user experience help mitigate some of the stress and foster a growth mindset?

90% of students who tested the Empowerly Score believed that knowing more about how the Score was composed, as well as what they needed to do to improve could help alleviate stress. In other words, the design of the interactions and the interface should be consistently intuitive, informative, and instructional.

The innovation: the ability to weigh up extracurricular activities and essays

Working on a spreadsheet made us realize that it was useful seeing all the school's data at a glance as it revealed interesting patterns. For example: which top 20 school has a relatively lower requirement for extracurriculars strength compared with others with similar reputation? We were also able to see in real number terms — as we moved down in the school rankings — how the importance of extracurriculars and essays reduce drastically relative to academic requirements like SATs and test scores. This was revealing, because previously no one had tried to give activities and admissions essays a quantifiable value.

As the data revealed unique insights, they continued to feed us ideas on how to build an interface that such information accessible for student users.

Final results

See the Empowerly Score in action

01
Final designs
/

Know where you stand, always

Jessie is stressed out by the competition and is always worried that she is not doing enough.

The “Suggested Scores” panel displays a list of schools that are already within Jessie’s reach to give her a sense of reassurance.

Visualize acitivty value

Jessie feels overworked but doesn’t know which activities are worth giving up and how to make the most of her activities.

The Extracurriculars page allows Jessie to arrange activities by Activity Value so that she can optimize her efforts. Conveniently, this is the order in which she should be listing them in her Common Apps—starting with the one that is weighted as the most significant.

Conclusion

Results and learnings

01
Results
/

Successful fundraising

Soon after the Empowerly Score was lauched, the company was able to secure $1.6 million in seed funds (and eventually Series A). Media attributed the innovation of the Empowerly Score as one of the critical contributing factors.

02
takeaways
/

Key learnings

1

UX is more than interface design

If design is the act of making a series of human-centric decisions, there was plenty of room for creativity in building the algorithm.

2

Static wireframes might not be the best way to measure user reaction to a product feature.

Make it a point to test user reaction by demonstrating the value they will receive in a personal and tangible way. In this case, it’s the generated Score first and foremost.

3

Good design does not always amount to a significant increase in engineering effort.

Sure, sometimes it does. In some cases, however, minor UX copy or UI placement changes may have little impact on engineering time while contributing to significant business gains.

Lai Jing joined Empowerly as our first UX designer when we were still pre-seed. It was clear from day one that her background in architecture translated well to being a UX designer. She understands how to design for people and constantly has the user’s best interest at heart. Lai Jing is incredibly thoughtful and thorough in research, from usability testing to interviews, and she develops strong processes and documentation that are crucial to any organization's success. I highly recommend Lai Jing - she is as detail-oriented, passionate, hard-working, and talented as they come.

— Hanmei Wu, Co-Founder at Empowerly

Lai Jing is a bright and passionate worker. She is a quick learner and is very organized with her projects and thoughts. She created the designs for the Empowerly student portal and completely revamped the Empowerly student experience. She helped our team culture as well by being very responsive and open to collaboration. Lai Jing was a pleasure to work with, and her passion for design and project management is unparalleled.

— Rashi Jindani, COO at Empowerly

Lai-Jing and I collaborated on user portal improvements and and student outreach for Empowerly while I was Community Manager. Hands down, she is one of the most responsive, hard-working, and genuinely driven co-workers I've had. Though our areas of expertise were very different, she learned very quickly and meaningfully incorporated feedback into the end product. Despite some setbacks and challenges that occurred during our time working together, she always had a positive attitude that cheered up me and anyone else who had the pleasure of working with her.

— Sheelah Bearfoot, Community Manager at Empowerly

Thank you for reading!

More case studies