Context
We live in an era of globalization where people seek to explore new cultures, societies, and languages. Duolingo is a popular language learning app that uses gamification to make learning fun and engaging. However, Duolingo mainly covers the basics and lacks effective conversational practice. Its voice recognition and AI chatbots are insufficient for achieving oral proficiency. For practical speaking and listening skills, users need to turn to other platforms, which can often be complex and intimidating.
Goals
Duolingo Chat is an extended feature with AR and AI technologies to leverage community to create language immersive experiences
Help users: help user to practice speaking and listening to a new language with each other
Help Duolingo: Increase usability
Problem Space
Market Research
Before diving into the project, I performed multiple research methods, to understand how the application was structured, how user interacted with the application, their challenges while using the app.We then synthesizing all the findings into 5 key points:
Audit Existing App
To take the learning experience to the next level and improve the learning flexibility, I audit the app with users to streamline the flow and reorganized the information architecture so the new feature would seamlessly integrate with the existing app structure.
Competitive Analysis
To gain a better understanding of the problem and the bigger picture, I analyzed major players in the market as well as parallel markets. Additionally, I read user reviews of various products to identify areas for improvement.
Here are some key takeaways:
- The competitive landscape is crowded with 20-40 different alternatives.
- While there are numerous apps and services for serious language learners, there are very few options for beginners and intermediate learners.
- Among language learning apps, Duolingo stands out as the most user-friendly due to its distinct graphics and design.
- Although Duolingo is suitable for all ages, it struggles to retain advanced users due to the lack of structure.
- Duolingo is the only app that allows users worldwide to access it for free, with the option to upgrade to the premium version.
Comparative Analysis
Taking Duolingo’s design and gamification into consideration, I did a comparative analysis to apps that have strong visual language and interesting gamification method like SnapChat and PokemonGo to explore new design opportunities.
We like that...
- Snapchat Filters allow users to have fun role playing with each other and be a different version of themselves. I thought that this feature could be implemented to our app so user can also choose to apply filter and be anonymous to lessen any fears they have conversing with others.
- I also explore the AR technology of Pokemon Go and want to extend this option for young user under who need more restricted content moderate and provide an immersive experience that allows young user to interact with each other in real life, but filtered through a screen
Conceptualize
User Personas
Goals
- Learn the basics of Spanish.
- Use simple phrases comfortably.
- Communicate with locals as needed.
Frustrations
- Limited vocabulary and sentence structure.
- Difficulty speaking with native speakers.
- Anxiety about being put on the spot.
Goals
- To be able to understand Korean song lyrics.
- Get more conversational practice with native speakers.
- Respond promptly in conversations.
Frustrations
- Fear of public failure and self-consciousness.
- Struggles with understanding fast native speech.
- Adapting to real-life conversations.
Product Features
Base on the research findings, we brainstormed ideas collectively and received feedback from other designers and decided to incorporate Augmented Reality (AR), Virtual Reality (VR) and Artificial Intelligence (AI) technologies to enhance the language learning experience. Taking inspiration from popular video games such as PokemonGo and the filter feature in Snapchat, I contemplated implementing the following features to create a more immersive virtual world:
- Customizable Character or AR filter
- Real-time virtual communication with other Duolingo users
- Option to travel to various locations to complete simple tasks.
Such as, getting coffee at the coffee shop, asking for direction at the bus stop, ect.
Information Architecture
I began thinking about the Information Architecture of my features, and how they would seamlessly integrate with the existing app structure.
// Existing architecture
Old Site Map shown the current free version of Duolingo presented six navigation icons that were unlabelled, causing confusion among new users during testing. I was then prompted to discuss which labels were most essential for an optimal learning experience.
// Proposed architecture
The new site map shown which features and navigation items should be present in the app and then find the proper “homes” for the features I would like to add to the app.
User Flows
Then I conducted an user flow, and have a more concrete idea of how user would engage in certain tasks.
AR Design
Wireframe Sketches
I developed a set of sketches that outline the layout and fundamental structure of an interface before incorporating its content, navigation, and visual design elements.
Usability Test
After creating low-fidelity sketches, I conducted paper testing with 5 key users to gather initial feedback and identify any overlooked issues. The findings revealed:
- Positive Feedback: Users were generally satisfied with the design.
- Young Users: I overlooked that the youngest user group (aged 13-17) needs more supervision when interacting with strangers.
- Safety Concerns: Users wanted safeguards to filter out those using the app for inappropriate purposes (like dating or selling).
Initially, I developed Duolingo Chat as a separate app, but users were hesitant to install an additional app, and some were unaware of its existence.
Potential Solutions:
- For Young Users: Allow minors (13-17) to chat only with Duolingo characters, supported by AI and AR, with increased moderation.
- Community Guidelines: Establish clear rules prohibiting selling, promoting social media, or dating. Enable users to report and block rule-breakers.
- Automated Moderation: Implement filters and tools to detect and remove inappropriate content or behavior.
- Integration: Incorporate Duolingo Chat directly into the main Duolingo app for better accessibility.
Design Propotype
The final design includes and end-to-end flow
Home/Learn
- Quest/Badges: Moved to Home for visibility and user engagement.
- Welcome Message & Profile Button: Creates a personal experience and declutters the navigation bar.
- Streamlined Navigation: Simplified to Learn (Home), Exercise, Connect, and Shop with highlighted icons for selected sections.
Practice
- Practice Tab: Allows users to review and strengthen language skills, featuring topics for speaking, listening, and writing exercises.
- Adaptive Topics: Exercises adapt to the user's skill level and progress, becoming more challenging over time.
AR Chat Room
- AR Technology: Real-time filters enhance the user experience during video chats.
- Recording & Feedback: Users can record conversations for self-assessment and receive structured prompts to facilitate smoother exchanges.
VR Chat Room
- Minors (13-17): Restricted to conversations with Duolingo characters, monitored by AI and AR.
- Real-life Conversations: VR display with Duo partners asking questions, visual aids, and AI feedback on pronunciation, grammar, and vocabulary.
Topic Card
- Guided Conversations: Topic cards with instructions help users engage in structured communication.
- Prompts: Includes topics like favorite foods, memorable experiences, and opinions on current events, with preparation time provided.
VR Design
VR Sketches
I am also trying my hand at creating scenarios and storyboards to demonstrate how Duolingo functions in a VR environment.
Ordering coffee and food at the Coffee Shop - Sarah
- Introduce Sarah, a busy marketing coordinator who wants to improve her Korean language skills.
Set the scene:
- Sarah finds herself in a virtual restaurant environment, ready to practice ordering food in Korean.
Storyboard:
Sarah successfully completes her order and receives virtual feedback on her language use.
Unity Model:
From the sketches, I tried to create the enviroment in Unity.
Keys learning objective:
- Using food and drink vocabulary (e.g., coffee, omelette, croissants,…).
- Forming complete sentences to express food preferences and dietary requirements.
- Understanding and responding to the waiter's questions or recommendations.
Result
While working on the project, I learned about 4 common player characteristics from Professor Richard A. Battle, a game researcher: Achievers, Explorers, Socializers, and Killers.
An important point to consider is the fact that no person is the same, there will be different type of player who will use the platform for different motives. So, when designing Duo-lingo Chat, we need to design a game mechanic that can satisfy the need and trigger user in different ways.
- Achievers focus on points, badges, and statuses, thus, Duo-lingo targets them with level points, XP points, leaderboard places, and leagues. The progress learner achieve is visible to other members of the platform and gives achievers a chance to show off their achievements.
- For Explorers who are more focused on delving into new areas and don’t care a lot about points, the feature offers new challenge and categories to unlock with each completed level.
- For the Socializers who are eager to collaborate and achieve goals with friends and other users, Duo-lingo Chat allow users to make friend and track the progress of other learners.
- The Killers (a smaller group compare to others – about 1%) are quite similar to achievers as they are motivated to earn points and progress, but they focus more on Winning and seeing others Lose. That’s where a leaderboard comes in handy. They yearn to win and are satisfied by the special values for the first three places on the leaderboard. People who don’t take the first 10 places are demoted to the previous league, which touches on that desire to see others lose.
Impact
- I loved this project because I was able to learn and explore new complex technologies and implementing them to new product features.
- In addition, I was also able to improve my prototyping skills, including sketching a storyboard and learning how to navigate around Unity which resulted in a better understanding of the end-to-end solution to help user practicing speaking a new language.
