ModlGuessr

This game is my submission for the Modern Stack Hackathon

ModlGuessr is a game where you need to find which Large Language Model you’re talking with. Inspired by GeoGuessr.

I was looking for a fun idea to built with Convex, Better Auth and Autumn

Gameplay

You pick a difficulty. Easy, medium, hard You enter a chat room You’re faced with a description of the AI’s persona. ie: “This AI believes it’s in the year 1995. Modern references will confuse it.” You can chat with the LLM, now knowing which one it is. There are 4 models to chose from As soon as you start chatting, a countdown starts You must pick one of the 4 options before the timer reaches the max. The longer you take to find which one it is, the less points you get This loop repeats 7 times In the end, you get a score and enter a leaderboard

The more correct answers you get in a row, the more you increase a streak multipler A fast LLM checks you managed to force the LLM to tell its name. If you did, you get an extra multiplier.

Business model

This is a hackathon project, not a very serious business idea. But, maybe it’ll be fun enough, and most of all, I want to implement Autumn and see how it works in a real situation.

So here is the planned model:

• Freemium, with a few free games (ie: 3) initally
• 1 free game per day
• Small subscription plan 9€/mo for more games per month
• One time payment, higher price price per ticket
• Pay as you go for unlimited play

Features to implement

As the main goal is to explore the stack, here are some features we can implement because the tools make it easy.

Roadmap

• Setup SvelteKit
• Setup Convex
  • Basic database structure (games)
  • Stream LLM calls directly from AI SDK front-end to a Convex HTTP endpoint
  • Leaderboard for the best scores (aggregate)
  • Live count of all tokens ever used (aggregate)
  • Auto-stop round after a given time (scheduled function)
  • Fetch and store AI models from Vercel AI Gateway regularly (cron)
  • Watch other players playing live
• Setup Better Auth
  • Google Auth
  • Username plugin
  • Find out and implement other relevant providers
• Setup Autumn
  • Define plans
  • Show and track feature (tickets to play a game)
  • Implement and test payment
• CD Pipeline
  • Auth is working
  • Convex prod is used
  • Autumn prod is used
• Create a blog to document learnings
• Gameplay with AI SDK
  • Find fun game loops
  • Create game rounds
  • Save messages
  • Display result and score
  • Move to next round
  • Save final game score
  • Enter data in leaderboard
  • Suggest next-game
  • Different difficulty level
  • Generate “contraints” to make the game less repetitive
• Analytics
• Homepage
• Referral program (Autumn + Resend)
  • Generate referral code
  • Redeem codes
  • Notify referer by email when a code is used
• Vapi
  • Put a button to call a sales person from pricing page
• Share
  • Nice OG images
• Multiplayer
• i18n

License

Shield:

This work is licensed under a Creative Commons Attribution 4.0 International License.