Moosha Moosha Mooshme

Shall we play a game?

Okay, I’ll start. “Peanut butter and…”?

What came to mind? Did you think “Jelly”?

Well, that’s right! That’s the answer. But… I never told you the rules. 

I guess you could tell you were supposed to fill in the blank, guessing not just A new word but the most LIKELY next word. 

Also, did you only guess one word or did you keep going, such as “Peanut butter and jelly is a great sandwich to have on a picnic”? I suspect not. 

So you also knew to fill in the blank with not just a string of words but one word. 

Let’s go another round. 

Ready?

“Happy birthday to….”

Did you guess “you”?

You did it again – you filled in the next, most likely single world. 

Ah, but what if I told you we were at an event for Sharon. And it was her birthday. 

Round 3: “Happy birthday to….”

Did you guess “Sharon”? 

My question didn’t change, but your answer did. What’s different this time? The context. Without me telling you, you changed the rule from the most likely single word to the most likely word IN CONTEXT. 

And those three rules, in a generalized way, is how emergent AIs like ChatGPT work: guess the next single word, in context. The tools can produce so many remarkably complex things, things that seem more powerful than just these simple rules, but in the end that’s all it comes down to. 

So at it’s core, understanding emergent AIs can be as easy as one, two…

(Did you guess “three”? That is: ). The next 2) single word 3) in context)

For almost three decades, I have taken personal and professional pleasure in taking deep dives into the latest disruptive technology and exploring its pro-social and educational potential. Web design (1995), online discussions (1998), video games (2002), virtual worlds (2005), XR (2016), and more. 

While emergent AI is just my latest, it caught me by surprise and is moving at a speed unlike anything I have ever experienced before. 

Last November I threw myself into exploring the tools, not just for producing text, but also images, video and audio. Last December I wrote about the experience after my first few weeks (Can generating art through AI still make me an artist if ordering food on GrubHub doesn’t make me a chef?) In it, I shared how I came to realize AI is not a competitor but a collaborator, not for exploring the realm of what is real (epistemology) but exploring what might be (aesthetics).  

Since then I have integrated it into every aspect of my personal and professional life. I am using it to design a card game, Uncannny Valley, designed to teach how to view the world as an AI. I use it to write legal documents, and my kids’ camp emails, and make sense of obfuscating medical instructions.

What led me to write this particular post, which I wanted to do for a few months, was that it has led me to get in front of groups of educators and non-profit professionals to help them understand this latest disruption to their classrooms and projects. 

As I write this mid-summer, I have already delivered or booked four different events which by the end of this year will have brought me before 1,000 people. I never expected to become the expert they are looking for, but, well, here I am. 

What I hope to do below is share HOW I am approaching the topic, in case it is of interest or use to others. 

The three things that have proven most effective have been:

1. AI Game Shows
2. AI Arcades
3. AI Roleplay

AI Games Shows

Many in my audience are scared. Their concerns are existential. AIs will replace them, or change their classrooms or workplace in ways more profound that COVID-19. 

In that context, a lecture – no matter how engaging – is a non-starter. Instead, I turn the mood around. I start with an over-the-top, dramatic game show, music blasting as I enter the stage. Working with my partners we then put on a 45-60 minute show that delves deep into what generative AIs are, and what role educators can have in shaping their future role in society… but we have a lot of fun along the way. 

There are three key sections. The first section is a game played with the audience, sharing a computer up on a screen. It is called CONTEXTO. It is simple: guess the word. As you guess words, you learn how close your guess is to the secret word of the day. With each guess you try to guess closer and closer until you figure it out. The neat trick here is the logic behind those relationships; you do better if your guess is more likely to appear with the secret word (within news articles, the basis for this one particular AI model). That essentially is how large language models work within emergent AIs. As we guess correct words closer and closer to the secret word, we start to see patterns. We ascribe meaning to our correct guesses. But this is false; the AI doesn’t understand why the connections exist between these words; it just knows that these connections exist, and that, it turns out, is enough. So this activity is a great way to playfully teach how AIs view the world. 

The first section is also secretly the game show recruitment phase; all participants who suggest words are invited to join a team. In the second phase, those teams are introduced to the audience. Like in an improv show, the audience is then invited to provide some prompts (ideally related to the topic of the gathering), in categories like character, settings, genre, and challenge. Then each team has a few minutes to rapidly write a story with chatGPT, as a creative collaborator, and share it; the audience then votes while guessing which prompts were selected. 

After each phase, teams get points. In the final round, with double points, each team takes one sentence from their story and generates a related image in Midjourney, to accompany their story. While all these stories are being written and images being generated, my and my co-host banter and highlight key aspects of the opportunities and challenges (ethical and otherwise) of working with generative AI. 

A small trophy is given to the winning team but everyone goes home happy… and a little more informed about how generative AIs work and the role we can all play to advocate for a pro-social outcome. 

AI Arcades

While the game shows are designed for an audience, AI Arcades are designed to maximize crowds and hands-on engagement. The first one I did set out 8 stations – some at tables, some at high boys for those standing. Each one had a guide and a different form of generative AI to play with. The idea here is that until you get past that first hurdle, you’ll never get over the fear of the unknown and start to have agency around your relationship with the tools and the impact they are having. In March we focused on:

• ChatGPT (text generation)
• Midjourney (image generation)
• Lensa (personal avatar generation)
• Parodist (celebrity voice/video generation)
• Character.ai (chat bot generation)
• Alexa (voice chat)
• Otter.ai (AI-driven audio transcription) 
• Uncannny Valley (my card game to welcome our future AI overlords!)

(On the first time I did this, I read the news on the way into the session: Character.ai had just been given a valuation of $1B).

AI Roleplay

The third approach I’ve been offering is for the more serious-minded. This maximizes hands-on, but focuses on the immediately practical applications of these tools. 

Everyone gets assigned to a team, representing a department within a company. Our company then sets out a new mission, such as to launch a new fundraising campaign. Each team then uses a different tool to collaborate with AIs to produce their piece of the project. One group writes a press release. Another creates a social media campaign. Another produces image assets for the first two to use. And so on.

At the end of the session, each “department” shows off their piece of the project and then, breaking roles, we explore the advantages and challenges of using generative AIs to super-power our work. 

Unlike with other consulting, this space is changing so fast, not just technologically but socially. There is much more concern this summer than in spring that generative AIs are built on unpaid labor. It is informing nation-wide strikes and lawsuits. And whether or not people are more informed, they are certainly more aware. 

Take for example this webinar that was canceled today. I am a member of the Author’s Guild. This summer over ten thousand members signed a petition that essentially says, “You can’t steal our jobs.” Next week was a webinar called “How to Use AI Writing Programs to Your Benefit” that they offered in response to members interest in the use of AI applications in their writing profession. In advance, registrants submitted hundreds of questions, and so far outside the scope of the Webinar they decided to scrap it and redesign it as a series later this fall, which will “allow for discussion and questions around the more nuanced elements of AI use.” 

That’s all well and good. But what I’ve learned, given the current rate of change, they might as well offer it now. Because whatever they plan to do in a few months is going to likely be outdated by the time it is offered. 

Luckily, I am comfortable with a high rate of change. 

Each year I am excited when I receive my invitation to be a judge for the GEE! Learning Game Awards run by the Play Make Learn conference at the University of Wisconsin. The award recognizes the significant impact of the learning theories used by good games described by James Paul Gee.

My team played a series of games, each time evaluating to what extent they matched or diverged from Gee’s framework. The game which stood out from the pack is Star Stuff. Below is a piece I prepared for the Gee! Awards blog, describing the game and why it won. I created the blog post by interviewing the three judges, transcribing it through Otter.ai, editing it down to focus on the topic, posted the raw data into chatGPT, then asked the AI to combine into a blog post which I then edited.

I hope this piece both introduces you to a fun game while also exploring how Gee’s ideas are a powerful framework that game designs can use to create games with impact.

Exploring the Cosmic Puzzles of Star Stuff: A Fun and Engaging Adventure

Game analysis by Akiva Joseph, Paolo Gambardella, and Monica Fan; Editing by Barry Joseph; writing by chatGPT 

Star Stuff is an exciting game that offers players a “cosmic puzzle automation adventure that mixes bot programming with real-time shenanigans.” Its designers set out to extract the essence of big ideas and make them accessible. With Star Stuff, their coding mechanics and bot interactions immerse the player in procedural logic & systems thinking while keeping the programming mechanic simple & fun. This opens up a world where you’re able to focus on planning rather than getting caught up in the code itself.  As players move through the game, they gain confidence by having the agency to easily experiment with new mechanics and practice breaking down big problems one step at a time.

Star Stuff is a Sokoban-style game – in which a player has to solve puzzles requiring the movement of objects – combined with a programming mechanic – as the player has to code robots to assist with the movement activity. The game requires the player to become fluent in the use of a pseudocode to control the movement of the robots, time their player’s movement to collaborate with the robots, and tackle one challenge at a time in a sequence as the levels get harder and new tools are introduced for tackling each one. 

In this post, we’ll delve into the mechanics and features of Star Stuff and how it exemplifies many of James Paul Gee’s 13 Principles of Good Learning Games. From Agency and Customization to Sequencing and Situated Meaning, Star Stuff offers players a captivating space to learn and have fun.

1. Agency: Feeling the Impact of Your Actions 

Star Stuff provides players with a sense of agency by allowing them to experiment with different combinations and learn through trial and error. Each action in the game has a consequence, reinforcing the idea that players’ choices matter. The game offers direct feedback on mistakes, empowering players to make informed decisions.

2. Customization: Solving Problems Your Way 

Star Stuff embraces customization by offering multiple solutions to puzzles. Players can devise their own strategies and find alternative ways to complete levels, providing a tailored learning experience. It encourages players to think creatively and adapt their approach to suit their learning needs and preferences.

3. Identity: Clear Goals and Sense of Purpose 

The game establishes a clear goal and sense of purpose for players, enhancing their sense of identity within the game world. By creating stars through solving puzzles, players have a long-term objective that drives their engagement. Star Stuff’s world-building and unique twist on star creation further reinforce the player’s sense of purpose.

4. Manipulation: Discovering New Mechanics 

Manipulation plays a significant role in Star Stuff. With each new level, players encounter fresh mechanics that they must discover and learn through experimentation. The absence of a tutorial encourages players to test and manipulate elements within the game to understand how these new mechanics function.

5. Sequencing: Gradual Complexity and Skill Progression 

Star Stuff employs a sequencing principle that gradually introduces more challenging puzzles as players progress. Foundational skills are built upon, ensuring players have a solid understanding of the game mechanics. Each new challenge allows players to apply previously learned skills in new and innovative ways.

6. The Pleasantly Frustrating Principle: Rewarding Challenges 

Star Stuff incorporates the principle of pleasantly frustrating gameplay. Overcoming challenges yields rewards, such as obtaining star fragments, which contribute to a sense of progress. Unlocking new puzzles introduces new mechanics, maintaining player engagement even when faced with initial frustration.

7. Cycle of Expertise: Applying Skills in New Contexts 

The cycle of expertise is a fundamental aspect of Star Stuff. Players acquire skills to overcome specific challenges and then practice those skills until they become second nature. However, the game continually challenges players to apply their expertise in new contexts, encouraging them to think critically and find innovative solutions.

8. Just-in-Time Information: Contextual Guidance 

Star Stuff provides information and explanations at the right time, avoiding overwhelming players with excessive tutorials. New functions are introduced as they become relevant to the gameplay, ensuring that players receive necessary information when needed, enhancing their understanding and retention.

9. Fish Tank: Learning Through Experimentation 

Star Stuff excels at creating a fish tank environment, allowing players to explore and experiment within contained levels. Each puzzle is self-contained within one screen, enabling players to try different approaches without disrupting the overall game progress. This promotes hands-on learning and discovery.

10. Skills Under Strategies: Motivating Skill Acquisition 

Star Stuff motivates players to learn essential skills by embedding them within a larger problem-solving context. By connecting skills to a broader strategy and narrative, the game ensures that players are motivated to acquire and apply these skills effectively.

11. System and Model: Grasping Complex Concepts 

Star Stuff effectively communicates complexity by presenting various interconnected systems within the game. Players must analyze these systems, including their character, items, and programmable robots, to create mental models and develop strategies for puzzle-solving. The game encourages critical thinking and exploration.

12. Situated Meaning: Contextualized Learning 

Star Stuff embraces the principle of situated meaning through the use of pseudocode. Players must understand and utilize pseudocode within the game’s context to direct robot actions effectively. The game demonstrates that meaning is not inherent in words or symbols alone but depends on the situation in which they are used.

Ultimately, Star Stuff offers a captivating and enjoyable gaming experience that embodies numerous learning principles. From empowering agency and customization to the gradual progression of challenges and the contextualized learning of situated meaning, the game effectively integrates educational elements within a fun and engaging space. 

Embark on a cosmic adventure, challenge your problem-solving skills, and explore the wonders of Star Stuff!

What WAS the Unreleased Games Arcade? Well, in a word: epic! Forty game developers – indie, AAA, and collegiate – came to the City College of New York last March to shared their unreleased games with 64 high school students studying game design.

That’s what the new Gaming Pathways is all about – creating connections among NYC high school youth of color, public college students studying game design, and NYC’s growing gaming industry.

So what IS an unreleased game? It could be a game anywhere in the game development process, from its earliest playable prototype (whether analog or digital) to something preparing to launch in a week. It could also be a chance to take that game that’s been sitting on the proverbial shelf collecting dust the last ten years and receive feedback from engaged and sharp players.

The feel of the event was electric and we hope to bring it back in 2024. Below you can get a taste for it within the videos we produced documenting the experience, the Yearbook we produced for presenters, and the photos as well.

Here is the 1 minute highlight reel from the event (created by Jose Alonso Baldeon):

But I recommend you skip that one and go right to his 5 minute version, with more interviews, shots of the games, and more cool stuff. Check that one out here:

We prepared a Yearbook documenting each of the games at the event (and listing who won which award). Click on the image below to check it out.

Here are some quotes from the presenters: “Gaming Pathways’ Unreleased Games Arcade was a blast! I had so much fun playing my game with students and talking shop about game design.” “This was a great way to playtest games and receive feedback in a nice fun way.” “Very well-attended event and well-managed and planned.” “I wish an event like this existed when I was in high-school! It would have been amazing to see games made by local developers and being inspired by their works!”

Finally, here are some great photos from the event (taken by Roderick Mickens):